-- Logs begin at Sat 2022-08-06 19:52:54 UTC, end at Sat 2022-08-06 21:05:50 UTC. -- Aug 06 20:28:59.553780 dv-cinder-851996-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 20:28:59.563372 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:28:59 2022] *** Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: nodename: dv-cinder-851996-5-iscsi Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: machine: x86_64 Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: clock source: unix Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: pcre jit disabled Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: detected number of CPU cores: 4 Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: current working directory: / Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: your processes number limit is 47680 Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: your memory page size is 4096 bytes Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: detected max file descriptor number: 2048 Aug 06 20:28:59.564437 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: lock engine: pthread robust mutexes Aug 06 20:28:59.565228 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: thunder lock: enabled Aug 06 20:28:59.565228 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 20:28:59.565228 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:28:59.603583 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: Python main interpreter initialized at 0x56377cf1a9c0 Aug 06 20:28:59.603583 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: python threads support enabled Aug 06 20:28:59.603769 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: your server socket listen backlog is limited to 100 connections Aug 06 20:28:59.603769 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:28:59.603905 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:28:59.604004 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: *** Operational MODE: preforking *** Aug 06 20:28:59.604264 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:28:59.604264 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: spawned uWSGI master process (pid: 103364) Aug 06 20:28:59.604455 dv-cinder-851996-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 20:28:59.605563 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: spawned uWSGI worker 1 (pid: 103365, cores: 1) Aug 06 20:28:59.605563 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: spawned uWSGI worker 2 (pid: 103366, cores: 1) Aug 06 20:28:59.605563 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:29:00.260122 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:29:00.269644 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:29:01.344189 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:29:01.344189 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: from cryptography.utils import int_from_bytes Aug 06 20:29:01.344785 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:29:01.344785 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: from cryptography.utils import int_from_bytes Aug 06 20:29:01.346447 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:29:01.346447 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: from cryptography.utils import int_from_bytes Aug 06 20:29:01.346988 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:29:01.346988 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: from cryptography.utils import int_from_bytes Aug 06 20:29:03.866243 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:29:03.866771 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:29:03.866927 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:29:03.867299 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:29:03.867558 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:29:03.867940 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.868266 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.868431 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:29:03.868881 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.868974 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:29:03.869058 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.869201 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.869299 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:29:03.869508 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.869594 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:29:03.869813 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:29:03.869902 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.870124 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.870215 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.870446 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.870529 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.870704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.870833 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871011 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871162 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871354 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-5-iscsi {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871525 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871674 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871842 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.871978 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.872166 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.872285 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.872488 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.872586 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.872820 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.872934 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.873083 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.873178 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.873403 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.873488 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.873731 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-5-iscsi {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.873949 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.874057 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875098 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875383 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875483 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875562 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875651 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875727 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875852 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.875947 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876025 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876107 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876237 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876237 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876433 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876539 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876690 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876818 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.876998 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.877103 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.877310 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.877493 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-5-iscsi {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.877648 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.877807 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.877967 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.878117 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.878286 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.878427 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.878612 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.878820 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.878943 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.879130 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.879258 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.879463 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.879580 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.879807 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880009 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-5-iscsi {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880139 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880331 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880447 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880649 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880770 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.880968 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.881085 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.881382 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.881474 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.881701 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.881787 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.881996 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.882088 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.882305 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.882396 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.882611 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.882695 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.882925 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883024 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883227 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883332 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883549 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883635 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883797 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.883891 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.884106 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.884198 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.884426 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.884522 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.884745 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.884840 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885062 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885159 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885313 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885405 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885561 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885704 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.885876 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886008 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886192 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886277 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886497 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886589 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886803 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.886892 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887109 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887201 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887438 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887534 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887745 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887829 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.887996 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.888089 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.888320 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.888418 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.888632 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.888738 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.888943 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889045 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889253 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889344 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889564 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889647 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889868 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.889952 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.890180 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.890263 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.890493 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.890583 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.890802 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.890892 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.891113 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.891203 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.891464 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.891563 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.891778 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.891869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.892085 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.892176 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.892399 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.892492 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.892716 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.892806 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893023 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893113 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893327 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893424 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893632 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893725 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.893953 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894037 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894280 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894440 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894585 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894699 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894832 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.894923 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.895127 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.895230 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.895979 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896068 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896296 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896380 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896602 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896694 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896907 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.896991 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.897210 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.897296 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.897507 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.897594 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.897812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.897905 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.898117 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.898202 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.898421 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.898506 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.898727 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.898811 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899033 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899127 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899365 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899508 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899672 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899759 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.899975 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900059 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900275 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900359 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900585 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900669 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900897 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.900987 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.901200 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.901284 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.901504 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.901592 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.901807 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.901901 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.902111 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.902197 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.902418 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.902500 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.902718 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.902811 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903022 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903150 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903364 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903475 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903669 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903773 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.903968 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904055 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904278 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904371 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904595 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904690 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904891 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.904976 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.905203 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.905289 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.905501 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.905600 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.905803 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.905888 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.906110 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.906194 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.906413 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.906515 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.906713 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.906799 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907012 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907096 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907331 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907433 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907631 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907717 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.907929 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908014 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908224 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908317 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908523 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908608 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908817 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.908907 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.909128 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.909232 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.909431 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.909515 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.909733 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.909823 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910036 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910122 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910333 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910417 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910634 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910727 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.910941 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.911111 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.911832 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.911918 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.912156 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.912253 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.912488 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.912579 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.912787 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.912881 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.913124 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.913285 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.913443 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.913530 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.913754 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.913878 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:29:03.914070 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.914400 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.914497 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.914710 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.915019 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.915102 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.915349 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.915667 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.915751 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.915984 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.916076 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.916311 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.916626 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.916711 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.916937 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.917254 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.917336 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.917564 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.917841 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.917926 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.918189 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.918429 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.918529 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.918781 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.918935 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.919126 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.919287 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.919488 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.919657 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.919799 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.920121 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.920257 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.920439 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.920749 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.920834 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.921056 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.921187 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.921364 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.921531 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.921680 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.921881 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922014 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922215 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922325 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922547 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922641 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922882 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.922978 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.923225 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.923333 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.923554 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.923655 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.923849 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.923945 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.924159 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.924255 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.924496 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.924581 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.924806 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.924899 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.925118 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.925203 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.925429 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.925525 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.925744 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.925848 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.926054 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.926146 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.926365 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.926450 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.926699 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.926818 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.927006 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.927196 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.927314 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.927556 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.927655 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.927916 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.928008 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.928218 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.928371 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.928536 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.928860 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.928974 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.929166 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.929491 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.929578 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.929793 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.930006 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.930094 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.930392 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.930506 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.930699 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.931002 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.931094 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.931333 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.931644 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.931741 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.931945 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.932262 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.932354 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.932569 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.932755 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.932873 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.933100 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.933195 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.933480 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.933571 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.933783 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.934095 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.934182 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.934405 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.934645 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.934730 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.934987 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.935072 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.935395 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.935482 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.935718 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.935803 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936030 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936126 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936341 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936428 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936664 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936749 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.936984 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.937070 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.937288 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.937380 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.937607 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.937694 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.937930 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938015 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938243 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938338 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938545 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938631 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938850 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.938949 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.939169 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.939391 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.939475 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.939565 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.939769 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.939864 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940076 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940185 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940378 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940507 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940680 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940822 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.940982 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.941155 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.941284 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.941478 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.941574 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.941795 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.941882 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.942130 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.942224 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.942499 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.942594 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.942800 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.942927 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.943103 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.943189 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.943452 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.943597 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.943762 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.943848 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.944085 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.944170 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.944406 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.944505 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.944742 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.944836 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945048 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945189 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945361 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945506 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945677 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945810 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.945986 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.946129 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.946297 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.946436 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.946608 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.946743 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.946919 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.947066 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.947236 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.947410 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.947568 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.947700 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.947889 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948020 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948225 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948364 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948508 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948652 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948794 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.948937 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.949095 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.949237 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.949401 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.949539 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.949698 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.949831 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950009 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950141 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950321 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950453 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950633 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950774 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.950960 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.951098 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.951290 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.951428 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.951606 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.951747 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.951911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952042 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952221 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952356 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952529 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952671 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952839 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.952980 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.953157 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.953296 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.953467 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.953611 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.953784 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.953873 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.954093 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.954244 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.954419 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.954551 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.954730 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.954860 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955047 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955209 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955367 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955500 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955672 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955804 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.955994 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.956126 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.956323 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.956475 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.956632 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.956728 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.956943 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.957029 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.957262 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.957349 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.957569 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.957654 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.958413 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.958520 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.958724 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.958810 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959031 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959124 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959361 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959512 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959671 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959756 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.959983 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960068 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960288 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960383 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960595 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960688 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960897 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.960989 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.961209 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.961303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.961780 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.961874 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.962082 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.962167 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.962382 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.962469 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.962692 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.962778 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963010 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963133 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963345 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963445 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963667 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963752 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.963985 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964078 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964287 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964374 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964589 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964676 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964912 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.964997 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.965218 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.965304 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.965522 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.965615 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.965824 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.965909 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.966126 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.966218 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.966463 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.966557 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.966770 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.966936 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.967071 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.967167 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.967405 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.967493 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.967724 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.967822 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968029 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968114 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968341 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968424 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968647 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968747 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.968952 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969038 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969267 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969351 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969574 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969708 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969879 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.969972 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.970186 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.970278 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.970493 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.970585 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.970801 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.970895 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.971108 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.971199 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.971444 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.971540 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.971748 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.971842 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972060 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972145 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972370 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972456 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972673 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972764 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.972980 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.973066 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.973296 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.973434 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.974151 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.974430 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.974573 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.974765 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.974911 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.975086 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.975215 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.975420 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.975556 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.975726 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.975862 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976042 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976174 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976370 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976516 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976661 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976794 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.976982 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.977117 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.977331 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.977475 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.977610 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.977751 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.977886 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978018 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978188 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978320 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978497 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978595 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978803 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.978934 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.979107 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.979271 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.979436 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.979577 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.979746 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.979843 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980049 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980135 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980351 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980438 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980651 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980736 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.980953 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981038 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981264 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981351 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981566 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981651 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981875 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.981962 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.982178 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.982264 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.982493 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.982578 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.982796 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.982880 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.983098 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.983398 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.983501 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.983714 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.983799 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.984052 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.984139 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.984355 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.984440 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.984686 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.984772 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985010 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985095 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985345 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985429 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985649 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985742 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.985952 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986039 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986271 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986371 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986573 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986659 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986874 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.986971 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.987174 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.987274 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.987507 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.987593 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.987816 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.987919 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.988117 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.988203 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.988428 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.988521 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.988738 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.988828 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989044 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989150 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989380 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989473 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989683 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989815 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.989990 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990077 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990288 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990372 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990599 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990693 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990906 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.990999 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.991204 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.991340 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.991526 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.991613 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.991834 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.991921 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.992139 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.992234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.992439 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.992526 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.992745 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.992838 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993047 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993140 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993359 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993490 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993659 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993745 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.993961 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994056 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994260 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994353 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994566 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994650 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994874 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.994968 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.995175 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.995280 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.995516 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.995606 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.995826 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.995921 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.996128 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.996222 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.996430 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.996516 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.996736 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.996823 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997038 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997124 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997340 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997425 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997646 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997740 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.997965 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998050 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998275 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998577 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998663 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998885 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.998971 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.999190 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.999340 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.999519 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.999604 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.999820 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:03.999906 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.000125 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.000222 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.000425 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.000518 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.000723 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.000808 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001022 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001120 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001319 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001405 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001620 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001709 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.001926 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002083 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002227 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002312 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002528 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002613 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002829 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.002915 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.003127 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.003213 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.003469 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.003566 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.003776 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.003868 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.004081 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.004166 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.004408 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.004497 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.004736 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.004824 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005049 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005142 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005358 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005442 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005669 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005765 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.005977 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006063 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006279 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006371 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006589 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006682 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006897 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.006984 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.007206 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.007332 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.007532 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.007619 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.007834 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.007919 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.008144 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.008237 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.008452 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.008536 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.008758 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.008842 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009072 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009170 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009378 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009462 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009686 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009773 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.009987 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010072 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010291 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010376 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010597 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010682 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010905 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.010991 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.011211 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.011316 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.011538 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.011625 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.011846 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.011938 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.012155 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.012242 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.012462 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.012546 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.012773 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.012872 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.013081 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.013168 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.013386 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.013488 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.013695 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.013791 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014004 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014097 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014306 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014401 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014627 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014720 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.014942 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015035 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015287 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015396 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015574 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015662 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015880 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.015967 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.016190 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.016284 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.016493 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.016579 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.016799 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.016915 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.017126 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.017213 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.017445 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.017540 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.017766 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.017852 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.018093 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.018181 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.018406 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.018497 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.018721 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.018815 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019032 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019118 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019362 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019450 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019679 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019771 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.019994 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.020127 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.020310 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.020907 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.021137 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.021228 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.021457 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.021545 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.021756 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.021841 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022068 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022167 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022387 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022471 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022688 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022772 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.022990 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.023084 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.023318 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.023407 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.023637 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.023758 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.023938 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024033 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024256 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024343 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024570 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024654 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024881 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.024975 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.025196 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.025284 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.025507 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.025658 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.025828 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.025970 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.026138 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.026403 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.026568 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.026684 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.026892 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.026986 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.027207 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.027316 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.027535 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.027621 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.027847 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.027935 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.028154 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.028247 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.028475 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.028561 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.028795 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.028882 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.029105 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.029189 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.029418 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.029512 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.029722 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.029815 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030040 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030127 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030360 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030464 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030670 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030765 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.030989 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.031076 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.031357 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.031526 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.031691 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.031779 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032004 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032091 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032315 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032411 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032624 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032719 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.032925 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033011 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033229 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033322 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033538 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033632 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033844 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.033964 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.034148 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.034280 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.034467 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.034592 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.034771 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.035011 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.035097 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.035351 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.035456 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.035674 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.035761 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.036527 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.036623 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.036846 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.036946 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.037168 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.037263 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.037470 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.037555 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.037785 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.037878 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.038093 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.038178 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.038412 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.038498 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.038728 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.038816 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039032 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039119 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039373 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039515 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039664 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039808 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.039969 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.040101 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.040273 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.040404 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.040575 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.040708 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.040914 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041046 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041216 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041363 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041534 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041677 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.041993 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.042181 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.042389 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.042526 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.042665 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.042806 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.042940 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.043113 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.043313 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.043457 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.043593 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.043753 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.043888 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044072 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044212 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044373 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044504 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044675 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044811 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.044982 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.045114 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.045287 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.045426 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.045594 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.045744 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.045885 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046028 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046185 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046321 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046486 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046630 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046772 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.046906 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.047073 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.047219 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.047416 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.047549 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.047719 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.047858 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048037 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048175 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048342 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048486 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048646 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048785 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.048949 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049081 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049252 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049415 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049550 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049685 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049858 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.049991 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.050192 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.050335 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.050499 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.050631 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.050816 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.050947 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.051131 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.051301 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.051468 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.051633 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.051818 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.051949 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.052134 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.052270 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.052447 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.052584 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.052759 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.052903 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053074 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053224 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053381 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053512 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053692 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053827 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.053999 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.054131 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.054309 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.054450 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.054616 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.054822 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.054969 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.055155 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.055262 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.055498 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.055600 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.055814 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.055903 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.056126 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.056211 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.056434 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.056521 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.056746 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.056843 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057055 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057142 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057367 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057454 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057677 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057764 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.057984 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.058071 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.058290 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.058375 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.058599 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.058687 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.058923 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059009 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059290 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059393 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059580 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059668 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059894 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.059980 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.060206 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.060302 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.060520 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.060608 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.060840 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.060924 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.061165 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.061252 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.061467 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.061552 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.061778 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.061864 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.062091 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.062178 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.062403 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.062495 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.062714 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.062799 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063021 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063112 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063359 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063460 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063671 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063759 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.063985 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.064200 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.064299 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.064545 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.064639 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.064874 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.064962 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.065191 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.065276 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.065510 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.065595 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.065829 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.065922 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.066140 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.066233 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.066449 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.066543 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.066762 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.066849 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.067081 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.067324 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.067455 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.067641 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.067793 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.067969 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.068124 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.068293 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.068457 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.068614 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.068802 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.068924 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.069124 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.069237 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.069448 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.069585 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.069770 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.069857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.070091 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.070184 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.070426 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.070514 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.070732 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.070827 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071032 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071118 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071370 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071472 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071679 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071766 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.071982 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.072068 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.072297 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.072384 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.072606 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.072692 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.072920 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.073128 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.073239 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.073469 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.073555 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.073780 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.073865 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.074102 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.074202 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.074422 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.074511 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.074740 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.074827 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.075047 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.075133 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.075398 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.075490 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.075706 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.075855 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076011 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076098 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076323 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076410 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076630 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076864 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.076952 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.077184 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.077270 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.077514 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.077599 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.077822 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.077919 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.078123 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.078216 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.078429 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.078515 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.078733 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.078819 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079058 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079145 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079488 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079695 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079788 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.079999 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.080085 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.080308 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.080401 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.080611 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.080696 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.080914 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081000 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081218 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081313 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081520 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081607 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081828 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.081913 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.082131 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.082226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.082438 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.082664 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.082750 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.083571 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.083675 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.083877 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.083969 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.084188 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.084276 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.084494 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.084598 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.084813 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.084900 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.085117 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.085203 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.085445 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.085538 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.085756 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.085882 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.086067 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.086153 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.086384 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.086729 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.086947 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087040 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087296 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087588 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087682 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087903 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.087990 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.088216 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.088430 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.088525 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.088762 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.088849 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.089080 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.089173 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.089410 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.089506 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.089730 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.089816 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090031 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090118 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090336 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090436 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090642 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090728 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.090951 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091035 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091272 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091360 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091586 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091681 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091890 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.091976 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.092196 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.092282 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.092502 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.092589 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.092805 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.092890 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.093112 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.093197 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.093415 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.093506 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.093720 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.093806 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094024 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094109 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094330 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094427 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094632 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094729 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.094936 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.095023 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.095250 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.095349 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.095569 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.095669 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.095908 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096046 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096225 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096320 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096540 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096636 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096855 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.096940 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.097169 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.097255 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.097478 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.097565 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.097786 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.098046 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.098133 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.098383 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.098519 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.098768 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.098855 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.099106 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.099192 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.099444 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.099559 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.099748 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.099832 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.100072 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.100157 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.100385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.100473 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.100717 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.100816 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101036 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101126 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101353 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101442 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101684 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101778 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.101988 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.102075 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.102296 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.102389 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.102609 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.102693 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.102915 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103002 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103227 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103332 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103562 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103648 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103876 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.103974 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.104193 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.104281 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.104503 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.104627 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.104807 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.104911 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.105111 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.105198 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.105418 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.105505 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.105735 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.105829 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106050 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106135 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106352 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106440 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106653 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106747 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.106960 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.107054 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.107294 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.107396 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.107605 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.107692 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.107908 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108002 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108212 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108299 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108519 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108612 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108822 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.108908 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.109125 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.109223 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.109426 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.109512 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.109727 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.109871 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110027 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110192 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110330 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110521 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110851 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.110937 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.111170 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.111285 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.111527 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.111613 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.111826 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.111913 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.112125 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.112211 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.112453 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.112540 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.112777 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.112870 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.113086 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.113172 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.113405 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.113499 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.113716 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.113812 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.114036 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.114652 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.114916 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115011 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115228 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115349 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115564 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115652 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115876 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.115968 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.116185 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.116367 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.116500 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.116588 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.116810 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.116896 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.117119 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.117214 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.117428 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.117521 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.117739 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.117826 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118048 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118135 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118355 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118441 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118666 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118753 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.118981 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.119068 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.119309 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.119399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.119622 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.119720 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.119935 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120022 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120246 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120341 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120555 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120650 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120863 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.120956 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.121176 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.121269 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.121486 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.121582 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.121793 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.121886 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.122100 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.122185 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.122409 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.122502 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.122714 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.122799 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.123030 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.123115 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.123366 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.123457 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.123682 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.123768 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124002 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124088 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124316 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124410 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124638 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124724 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.124950 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125035 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125256 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125349 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125580 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125673 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125896 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.125990 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.126213 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.126346 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.126542 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.126627 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.126855 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.126952 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.127173 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.127313 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.127517 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.127602 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.127828 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.127931 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.128134 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.128220 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.128376 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:29:04.128463 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.128765 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.129099 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.129411 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.129797 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.130128 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.130456 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.130778 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.131100 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.131463 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.131785 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.132105 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.132445 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.132741 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.133058 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.133382 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.133700 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.134021 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.134344 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.134667 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.135001 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.135357 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.135676 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.136009 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.136342 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.136696 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.137017 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.137371 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.137709 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.138031 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.138352 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.138664 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:29:04.138913 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103365) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:29:04.280827 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO dbcounter [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Registered counter for database nova_api Aug 06 20:29:04.291546 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Registered counter for database nova_api Aug 06 20:29:04.300891 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_db.sqlalchemy.engines [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.307568 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writer thread running {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.311121 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.318082 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.362952 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.context [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbdc6e2-4490-4e80-be96-0962cc011caf(cell1) {{(pid=103366) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:29:04.366895 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_concurrency.lockutils [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:29:04.367342 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_concurrency.lockutils [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:29:04.368908 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_concurrency.lockutils [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:29:04.369622 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_concurrency.lockutils [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:29:04.370063 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_concurrency.lockutils [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:29:04.372062 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_concurrency.lockutils [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:29:04.373580 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.context [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbdc6e2-4490-4e80-be96-0962cc011caf(cell1) {{(pid=103365) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:29:04.374024 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO dbcounter [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Registered counter for database nova_cell0 Aug 06 20:29:04.377418 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:29:04.377897 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:29:04.379419 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO dbcounter [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Registered counter for database nova_cell1 Aug 06 20:29:04.379537 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:29:04.380759 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:29:04.381208 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:29:04.383193 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:29:04.385229 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Registered counter for database nova_cell0 Aug 06 20:29:04.387056 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_db.sqlalchemy.engines [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.389339 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_db.sqlalchemy.engines [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.390945 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Registered counter for database nova_cell1 Aug 06 20:29:04.394306 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writer thread running {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.397641 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writer thread running {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.398709 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.402216 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.404289 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.538524 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO dbcounter [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Registered counter for database nova_cell0 Aug 06 20:29:04.544074 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.545618 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG oslo_db.sqlalchemy.engines [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.549729 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writer thread running {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.553911 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO dbcounter [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Registered counter for database nova_cell0 Aug 06 20:29:04.562869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_db.sqlalchemy.engines [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103365) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:29:04.567254 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writer thread running {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:29:04.885912 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: WARNING keystonemiddleware.auth_token [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:29:04.888902 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:29:04.893195 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: WARNING keystonemiddleware.auth_token [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:29:04.896121 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:29:05.232429 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: WARNING keystonemiddleware.auth_token [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:29:05.233639 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:29:05.238287 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: WARNING keystonemiddleware.auth_token [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:29:05.239611 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: WARNING keystonemiddleware.auth_token [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:29:05.243685 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56377cf1a9c0 pid: 103366 (default app) Aug 06 20:29:05.244836 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56377cf1a9c0 pid: 103365 (default app) Aug 06 20:29:05.245748 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:29:05.246899 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-7451ac63-07ba-49a0-a8d9-e058df0d62be None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001696 Aug 06 20:29:05.247321 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sat Aug 6 20:29:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:20.955591 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:20.956864 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 06 20:30:20.957250 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:20.972727 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writing DB stats nova_api:SELECT=3 {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:20.973855 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writing DB stats nova_cell1:SELECT=3 {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:20.974614 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writing DB stats nova_cell0:SELECT=3 {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:20.975698 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:21.872266 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-f4e96bf8-ecbb-4837-ba7e-cabcf0487e3d admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:21.907787 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-f4e96bf8-ecbb-4837-ba7e-cabcf0487e3d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.944474 Aug 06 20:30:21.908629 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 20:30:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:24.204073 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:24.204866 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-9f71f2fd-e01b-409a-92c6-90cad30a25ac None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 06 20:30:24.210102 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:24 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:24.668087 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-8232791e-b9e8-4521-91f0-736b017d4a72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 256}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:24.690203 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:30:24.690203 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: warnings.warn(msg) Aug 06 20:30:24.718785 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-8232791e-b9e8-4521-91f0-736b017d4a72 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507516 Aug 06 20:30:24.727014 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:24.733409 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.734398 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell0:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.735615 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell1:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.736488 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell0:SELECT=3 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.946906 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-b775d37b-4b3f-4ddc-b6c7-6e40ae6ca8d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:24.951376 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:30:24.951376 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 06 20:30:25.029998 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-b775d37b-4b3f-4ddc-b6c7-6e40ae6ca8d6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301739 Aug 06 20:30:25.031604 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 20:30:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:30:27.234737 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-8232791e-b9e8-4521-91f0-736b017d4a72 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:27.236677 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-8232791e-b9e8-4521-91f0-736b017d4a72 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002423 Aug 06 20:30:27.238154 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:30:27.911676 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-d561e6ff-c9e7-4d89-ad71-72dc976db9fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 5}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:27.933618 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:30:27.933618 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 06 20:30:27.957454 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-d561e6ff-c9e7-4d89-ad71-72dc976db9fe admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.712600 Aug 06 20:30:27.963613 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:27.971146 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-1a51a5b8-539d-4e04-a174-feb24da2744e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:27.974164 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:30:27.974164 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: warnings.warn(msg) Aug 06 20:30:28.016011 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-1a51a5b8-539d-4e04-a174-feb24da2744e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048689 Aug 06 20:30:28.016723 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 20:30:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:30.445524 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-d561e6ff-c9e7-4d89-ad71-72dc976db9fe admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:30.446843 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-d561e6ff-c9e7-4d89-ad71-72dc976db9fe admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Aug 06 20:30:30.447869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:30.852886 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-832a9d07-a5ef-4a1b-9a90-6b87272d517d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:30.873329 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-832a9d07-a5ef-4a1b-9a90-6b87272d517d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419813 Aug 06 20:30:30.874328 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:30.886547 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-d80ede8b-9e6b-4576-991d-996384ac55c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:30.915482 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-d80ede8b-9e6b-4576-991d-996384ac55c2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032985 Aug 06 20:30:30.916296 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 20:30:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:30:33.158083 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-832a9d07-a5ef-4a1b-9a90-6b87272d517d admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:33.159707 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-832a9d07-a5ef-4a1b-9a90-6b87272d517d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 06 20:30:33.163846 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:33 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:33.676828 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6bdf40f6-c1f0-4e61-993e-af5a7bcc316b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "disk": 10}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:33.701852 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-6bdf40f6-c1f0-4e61-993e-af5a7bcc316b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529957 Aug 06 20:30:33.707457 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:30:33.715875 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-15d41f35-1c46-4e8c-92a0-2051db58bc39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:33.759015 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-15d41f35-1c46-4e8c-92a0-2051db58bc39 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047515 Aug 06 20:30:33.759750 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 20:30:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:36.030565 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6bdf40f6-c1f0-4e61-993e-af5a7bcc316b admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:36.033269 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-6bdf40f6-c1f0-4e61-993e-af5a7bcc316b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003076 Aug 06 20:30:36.040240 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:36.537154 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-d08a5d74-f7a3-4acb-beda-826286d72bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:36.562119 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-d08a5d74-f7a3-4acb-beda-826286d72bab admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520712 Aug 06 20:30:36.567745 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:36.576513 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-77a6b0b3-0674-4356-bb6a-9a7c3b9fcdc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:36.624583 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-77a6b0b3-0674-4356-bb6a-9a7c3b9fcdc3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051994 Aug 06 20:30:36.625862 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 20:30:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:38.907047 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-d08a5d74-f7a3-4acb-beda-826286d72bab admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:38.908126 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-d08a5d74-f7a3-4acb-beda-826286d72bab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 06 20:30:38.908561 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:39.330828 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-68bfc0b2-d861-4bf7-b2e9-420120188e6e admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:39.356635 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-68bfc0b2-d861-4bf7-b2e9-420120188e6e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441570 Aug 06 20:30:39.357129 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 20:30:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:30:41.618882 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-d08a5d74-f7a3-4acb-beda-826286d72bab admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:41.619966 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-d08a5d74-f7a3-4acb-beda-826286d72bab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 06 20:30:41.620374 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:42.059082 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c74ff255-c526-495f-8572-0343298d07fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "disk": 1}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:42.080431 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c74ff255-c526-495f-8572-0343298d07fc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453635 Aug 06 20:30:42.081132 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:42.094715 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-fd7987b9-9095-4f7e-987f-cb787553d26b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:42.120501 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-fd7987b9-9095-4f7e-987f-cb787553d26b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030571 Aug 06 20:30:42.121084 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 20:30:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:44.384787 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c74ff255-c526-495f-8572-0343298d07fc admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:44.385851 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c74ff255-c526-495f-8572-0343298d07fc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 06 20:30:44.386248 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:44.792030 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-5894c4f7-1add-4508-baaa-83703a56987a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:44.810855 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-5894c4f7-1add-4508-baaa-83703a56987a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.418665 Aug 06 20:30:44.811479 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:44.823940 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-887747ad-fb5d-4076-956d-8224228f8c34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:44.846935 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-887747ad-fb5d-4076-956d-8224228f8c34 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026731 Aug 06 20:30:44.847536 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 20:30:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:30:47.108713 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-5894c4f7-1add-4508-baaa-83703a56987a admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:47.109752 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-5894c4f7-1add-4508-baaa-83703a56987a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 06 20:30:47.110144 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:47.585028 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-cbdeda83-6ef5-4ef9-91a4-d32a71de188b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:47.605835 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-cbdeda83-6ef5-4ef9-91a4-d32a71de188b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.488858 Aug 06 20:30:47.606381 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:30:47.618877 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-1e63eb48-6a20-43af-9fcb-7d996ab54301 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:47.642599 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-1e63eb48-6a20-43af-9fcb-7d996ab54301 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027434 Aug 06 20:30:47.643259 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 20:30:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:49.874285 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-cbdeda83-6ef5-4ef9-91a4-d32a71de188b admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:49.875999 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-cbdeda83-6ef5-4ef9-91a4-d32a71de188b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Aug 06 20:30:49.876439 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:50.301676 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-7661bf65-6ad3-4860-894e-e7be347c3397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:50.328047 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-7661bf65-6ad3-4860-894e-e7be347c3397 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445782 Aug 06 20:30:50.329762 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:50.341608 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-823a202c-14ad-45db-b737-dbb6e4bc25db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:50.367871 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-823a202c-14ad-45db-b737-dbb6e4bc25db admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029824 Aug 06 20:30:50.368439 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 20:30:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:30:52.629278 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-7661bf65-6ad3-4860-894e-e7be347c3397 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:30:52.630393 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-7661bf65-6ad3-4860-894e-e7be347c3397 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Aug 06 20:30:52.631101 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:30:53.095875 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-e5be2f62-849e-4e1f-b259-dfb0cb903cb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:53.116578 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-e5be2f62-849e-4e1f-b259-dfb0cb903cb9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478686 Aug 06 20:30:53.117127 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 20:30:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:30:53.129345 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-f916182f-1261-402b-9b5e-3eb4e46b7727 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:30:53.137685 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:53.159439 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-f916182f-1261-402b-9b5e-3eb4e46b7727 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033906 Aug 06 20:30:53.160026 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 20:30:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:31:13.312874 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-e5be2f62-849e-4e1f-b259-dfb0cb903cb9 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:13.313887 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-e5be2f62-849e-4e1f-b259-dfb0cb903cb9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 06 20:31:13.314285 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:13.695133 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-1670fead-61db-441f-a0b4-dde44868616c admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:13.713187 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-1670fead-61db-441f-a0b4-dde44868616c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.392968 Aug 06 20:31:13.713717 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 20:31:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:31:14.888260 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-e5be2f62-849e-4e1f-b259-dfb0cb903cb9 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:14.889267 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-e5be2f62-849e-4e1f-b259-dfb0cb903cb9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 06 20:31:14.890189 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:15.406440 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-9a261640-957a-42d7-817e-3f249d3750c0 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:15.412044 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.wsgi [None req-9a261640-957a-42d7-817e-3f249d3750c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-9a261640-957a-42d7-817e-3f249d3750c0 admin admin] Request method failure captured: Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Accept: application/json Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Accept-Encoding: gzip, deflate Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Connection: keep-alive Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Content-Length: 0 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Host: 10.222.0.17 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Openstack-Api-Version: compute 2.90 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Openstack-System-Scope: None Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: User-Agent: python-novaclient Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Auth-Token: gAAAAABi7s-S90xTUr4FruO0myeygJhGQpq3u7iR91uv3ewwYP6RTTpTAomZoL1hNTSR4qJs_k-rUI4lYR9IjdsrT9MsTjycymmju5TxUbSn43xMBxpSIP8Pfftz1luoPod_8v27juHWKgPwcSbQlvGkEIUTkDRlhesSFpEUNWhqjzE47B9qR48 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Domain-Id: None Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Domain-Name: None Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Identity-Status: Confirmed Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Is-Admin-Project: True Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Domain-Id: default Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Domain-Name: Default Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Name: admin Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Role: reader,admin,member Aug 06 20:31:15.415231 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Roles: reader,admin,member Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant: admin Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant-Name: admin Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User: admin Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Domain-Id: default Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Domain-Name: Default Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Id: 2fd914dd7cd747d0a7fae61653c493f6 Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Name: admin Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: method: > Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: exception: Flavor 42 could not be found. Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: action_args: {'id': '42'} Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:31:15.416812 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:15.417909 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.419387 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-9a261640-957a-42d7-817e-3f249d3750c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:31:15.420640 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-9a261640-957a-42d7-817e-3f249d3750c0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388689 Aug 06 20:31:15.420640 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 20:31:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:15.426197 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-c7dbd016-8703-43c9-8794-f2ca74204f64 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:15.430410 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:15.449986 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-c7dbd016-8703-43c9-8794-f2ca74204f64 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027352 Aug 06 20:31:15.450521 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 20:31:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:31:15.460971 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-54a8b2b0-1eb7-414e-b704-9dbcecb456ec admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:15.484269 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-54a8b2b0-1eb7-414e-b704-9dbcecb456ec admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027034 Aug 06 20:31:15.484786 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 20:31:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:31:15.494555 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4eb97856-ca3f-45ea-9a5e-482e64a9a29e admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:15.501570 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.wsgi [None req-4eb97856-ca3f-45ea-9a5e-482e64a9a29e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4eb97856-ca3f-45ea-9a5e-482e64a9a29e admin admin] Request method failure captured: Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Accept: application/json Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Accept-Encoding: gzip, deflate Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Connection: keep-alive Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Content-Length: 0 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Host: 10.222.0.17 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Openstack-Api-Version: compute 2.90 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Openstack-System-Scope: None Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: User-Agent: python-novaclient Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Auth-Token: gAAAAABi7s-S90xTUr4FruO0myeygJhGQpq3u7iR91uv3ewwYP6RTTpTAomZoL1hNTSR4qJs_k-rUI4lYR9IjdsrT9MsTjycymmju5TxUbSn43xMBxpSIP8Pfftz1luoPod_8v27juHWKgPwcSbQlvGkEIUTkDRlhesSFpEUNWhqjzE47B9qR48 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Domain-Id: None Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Domain-Name: None Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Identity-Status: Confirmed Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Is-Admin-Project: True Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Domain-Id: default Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Domain-Name: Default Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Name: admin Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Role: reader,admin,member Aug 06 20:31:15.504850 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Roles: reader,admin,member Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant: admin Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant-Name: admin Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User: admin Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Domain-Id: default Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Domain-Name: Default Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Id: 2fd914dd7cd747d0a7fae61653c493f6 Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Name: admin Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: method: > Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: exception: Flavor 42 could not be found. Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: action_args: {'id': '42'} Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:31:15.506385 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:15.507234 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:15.508399 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4eb97856-ca3f-45ea-9a5e-482e64a9a29e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:31:15.509568 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-4eb97856-ca3f-45ea-9a5e-482e64a9a29e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015880 Aug 06 20:31:15.509568 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 20:31:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:16.467869 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-54a8b2b0-1eb7-414e-b704-9dbcecb456ec admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:16.468873 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-54a8b2b0-1eb7-414e-b704-9dbcecb456ec admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 06 20:31:16.469261 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:16.988204 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-f4b45d20-63b2-4f6f-9009-8dd55efa6a1f admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:16.996676 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.wsgi [None req-f4b45d20-63b2-4f6f-9009-8dd55efa6a1f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-f4b45d20-63b2-4f6f-9009-8dd55efa6a1f admin admin] Request method failure captured: Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Accept: application/json Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Accept-Encoding: gzip, deflate Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Connection: keep-alive Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Content-Length: 0 Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Host: 10.222.0.17 Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Openstack-Api-Version: compute 2.90 Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Openstack-System-Scope: None Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: User-Agent: python-novaclient Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Auth-Token: gAAAAABi7s-UjVVnHycA1GGbgHNJ57_WZQlTQi5jTWdRGHa57PEAef8T5G37lVRMF5XSVX-oh3oMBuNFAr9ismCPv9dnpUofLh27RWothvrzUAfrU5k1i_z6mxaJkt6ZjWhpPDTUztaJXtGghewq4iROGebawKyZ0vC5NZNpnC1rOSYFJOl__3A Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Domain-Id: None Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Domain-Name: None Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Identity-Status: Confirmed Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Is-Admin-Project: True Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Domain-Id: default Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Domain-Name: Default Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Name: admin Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Role: reader,admin,member Aug 06 20:31:16.998214 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Roles: reader,admin,member Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant: admin Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant-Name: admin Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User: admin Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Domain-Id: default Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Domain-Name: Default Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Id: 2fd914dd7cd747d0a7fae61653c493f6 Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Name: admin Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: method: > Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: exception: Flavor 84 could not be found. Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: action_args: {'id': '84'} Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:31:16.999533 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:17.000303 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.001395 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-f4b45d20-63b2-4f6f-9009-8dd55efa6a1f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:31:17.002701 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-f4b45d20-63b2-4f6f-9009-8dd55efa6a1f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389024 Aug 06 20:31:17.002701 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 20:31:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:17.009728 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-eb273966-af58-4856-85d8-c03546837ee1 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:17.024876 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-eb273966-af58-4856-85d8-c03546837ee1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018621 Aug 06 20:31:17.025336 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 20:31:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:31:17.034774 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-f821d781-94d1-4045-bf74-b03aa7b3e39e admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:17.050397 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-f821d781-94d1-4045-bf74-b03aa7b3e39e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019025 Aug 06 20:31:17.050915 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 20:31:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:31:17.059961 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-4468b845-e3b0-4592-b94a-44083700c9ea admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:17.065224 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.wsgi [None req-4468b845-e3b0-4592-b94a-44083700c9ea admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-4468b845-e3b0-4592-b94a-44083700c9ea admin admin] Request method failure captured: Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Accept: application/json Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Accept-Encoding: gzip, deflate Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Connection: keep-alive Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Content-Length: 0 Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Host: 10.222.0.17 Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Openstack-Api-Version: compute 2.90 Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Openstack-System-Scope: None Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: User-Agent: python-novaclient Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Auth-Token: gAAAAABi7s-UjVVnHycA1GGbgHNJ57_WZQlTQi5jTWdRGHa57PEAef8T5G37lVRMF5XSVX-oh3oMBuNFAr9ismCPv9dnpUofLh27RWothvrzUAfrU5k1i_z6mxaJkt6ZjWhpPDTUztaJXtGghewq4iROGebawKyZ0vC5NZNpnC1rOSYFJOl__3A Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Domain-Id: None Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Domain-Name: None Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Identity-Status: Confirmed Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Is-Admin-Project: True Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Domain-Id: default Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Domain-Name: Default Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Name: admin Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Role: reader,admin,member Aug 06 20:31:17.066704 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Roles: reader,admin,member Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant: admin Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant-Name: admin Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User: admin Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Domain-Id: default Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Domain-Name: Default Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Id: 2fd914dd7cd747d0a7fae61653c493f6 Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Name: admin Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: method: > Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: exception: Flavor 84 could not be found. Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: action_args: {'id': '84'} Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:31:17.068220 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:17.069234 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:17.070489 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-4468b845-e3b0-4592-b94a-44083700c9ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:31:17.071739 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-4468b845-e3b0-4592-b94a-44083700c9ea admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011550 Aug 06 20:31:17.071739 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 20:31:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 20:31:18.096482 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-f821d781-94d1-4045-bf74-b03aa7b3e39e admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:18.097524 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-f821d781-94d1-4045-bf74-b03aa7b3e39e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 06 20:31:18.097916 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:18.619072 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-1dd96dbf-b69d-4142-9187-573d716c2205 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:18.625386 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.wsgi [None req-1dd96dbf-b69d-4142-9187-573d716c2205 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-1dd96dbf-b69d-4142-9187-573d716c2205 admin admin] Request method failure captured: Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Accept: application/json Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Accept-Encoding: gzip, deflate Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Connection: keep-alive Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Content-Length: 0 Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Host: 10.222.0.17 Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Openstack-Api-Version: compute 2.90 Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Openstack-System-Scope: None Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: User-Agent: python-novaclient Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Auth-Token: gAAAAABi7s-VXfdBnLyJdXGwxBs8nGhv1weMq1z1kSbYFLlnFE8a8vSbNxCRC7ywdCvZEJ49r_x7-2RuHxTy08rrbOcqUu-6fTMKYDOsZ2spq5XN0FeX5YTedHVrSE6p8uXvPdSrOWzV8PwOnb7LUoMWaMTHsoEXnIcyKuTGsza5zlEtdRgDnDY Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Domain-Id: None Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Domain-Name: None Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Identity-Status: Confirmed Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Is-Admin-Project: True Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Domain-Id: default Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Domain-Name: Default Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Project-Name: admin Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Role: reader,admin,member Aug 06 20:31:18.626857 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Roles: reader,admin,member Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant: admin Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-Tenant-Name: admin Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User: admin Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Domain-Id: default Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Domain-Name: Default Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Id: 2fd914dd7cd747d0a7fae61653c493f6 Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: X-User-Name: admin Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: method: > Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: exception: Flavor 451 could not be found. Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: action_args: {'id': '451'} Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:31:18.628576 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:18.629633 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.630911 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-1dd96dbf-b69d-4142-9187-573d716c2205 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:31:18.632180 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-1dd96dbf-b69d-4142-9187-573d716c2205 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391926 Aug 06 20:31:18.632180 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 20:31:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:18.637897 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-15ae11d9-46ab-4438-a3ed-74a4054c3ddf admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:18.652901 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-15ae11d9-46ab-4438-a3ed-74a4054c3ddf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018634 Aug 06 20:31:18.653417 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 20:31:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:31:18.662581 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:18.677983 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018836 Aug 06 20:31:18.678509 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 20:31:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:31:18.688235 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-a4a8104a-8eaa-4921-a2c3-3f7a17112045 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:18.693410 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.wsgi [None req-a4a8104a-8eaa-4921-a2c3-3f7a17112045 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-a4a8104a-8eaa-4921-a2c3-3f7a17112045 admin admin] Request method failure captured: Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Accept: application/json Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Accept-Encoding: gzip, deflate Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Connection: keep-alive Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Content-Length: 0 Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Host: 10.222.0.17 Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Openstack-Api-Version: compute 2.90 Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Openstack-System-Scope: None Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: User-Agent: python-novaclient Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Auth-Token: gAAAAABi7s-VXfdBnLyJdXGwxBs8nGhv1weMq1z1kSbYFLlnFE8a8vSbNxCRC7ywdCvZEJ49r_x7-2RuHxTy08rrbOcqUu-6fTMKYDOsZ2spq5XN0FeX5YTedHVrSE6p8uXvPdSrOWzV8PwOnb7LUoMWaMTHsoEXnIcyKuTGsza5zlEtdRgDnDY Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Domain-Id: None Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Domain-Name: None Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Identity-Status: Confirmed Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Is-Admin-Project: True Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Domain-Id: default Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Domain-Name: Default Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Project-Name: admin Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Role: reader,admin,member Aug 06 20:31:18.694869 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Roles: reader,admin,member Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ec2c82e54624d69af0962b9e3a7a4d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant: admin Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant-Id: 2ec2c82e54624d69af0962b9e3a7a4d9 Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-Tenant-Name: admin Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User: admin Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Domain-Id: default Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Domain-Name: Default Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Id: 2fd914dd7cd747d0a7fae61653c493f6 Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: X-User-Name: admin Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: method: > Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: exception: Flavor 451 could not be found. Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: action_args: {'id': '451'} Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:31:18.696369 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:18.697226 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: ERROR nova.api.openstack.wsgi Aug 06 20:31:18.698361 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-a4a8104a-8eaa-4921-a2c3-3f7a17112045 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103365) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:31:18.699400 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-a4a8104a-8eaa-4921-a2c3-3f7a17112045 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012191 Aug 06 20:31:18.699400 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 20:31:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 20:31:19.652738 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:19.653807 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 06 20:31:19.654197 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:20.160880 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-d59fdb06-d624-489f-b29f-c2e7baf0c998 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:31:20.179950 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-d59fdb06-d624-489f-b29f-c2e7baf0c998 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.388752 Aug 06 20:31:20.180479 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 20:31:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:31:21.141005 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:21.141998 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 06 20:31:21.142419 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:21.658794 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-7e911055-7135-4ae6-9af9-8e9f768c1f94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:31:21.677301 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-7e911055-7135-4ae6-9af9-8e9f768c1f94 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400454 Aug 06 20:31:21.677829 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 20:31:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:31:22.653946 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:22.655563 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 06 20:31:22.655966 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:23.175323 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-083b7e13-3a12-47c3-9039-22b85a0156b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:31:23.194994 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-083b7e13-3a12-47c3-9039-22b85a0156b1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.397501 Aug 06 20:31:23.195579 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 20:31:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:31:24.144676 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:24.145711 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 06 20:31:24.146113 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:31:24.670986 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-25a01a54-d77b-4ffd-b6b9-dfe6872546a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:31:24.689390 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-25a01a54-d77b-4ffd-b6b9-dfe6872546a8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399362 Aug 06 20:31:24.689930 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 20:31:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 20:31:25.659534 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:25.660657 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Aug 06 20:31:25.661055 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:31:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:31:26.211715 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-6f52fd98-c8f6-4910-80a8-cc858f676896 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:31:26.232428 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-6f52fd98-c8f6-4910-80a8-cc858f676896 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402514 Aug 06 20:31:26.232966 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Aug 6 20:31:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:32:17.045769 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:32:17.046744 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-187aa38e-dc76-4bf1-877e-b159500fda58 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 06 20:32:17.047134 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 20:32:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:32:17.058040 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:17.444593 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-9de633fb-3d9f-4e81-b3bf-b4ddd1e2b502 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:32:17.465384 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-9de633fb-3d9f-4e81-b3bf-b4ddd1e2b502 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412334 Aug 06 20:32:17.465855 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 20:32:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:32:17.489500 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-75d10418-9a21-454d-98c3-529431084be0 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:32:17.492923 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG dbcounter [-] [103366] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:17.498545 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-75d10418-9a21-454d-98c3-529431084be0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012598 Aug 06 20:32:17.499069 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Aug 6 20:32:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:32:17.510421 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-cfd5fcf2-347b-4e1b-aacd-ce674eb7c8ea admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:32:17.517884 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-cfd5fcf2-347b-4e1b-aacd-ce674eb7c8ea admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010942 Aug 06 20:32:17.518389 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Aug 6 20:32:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:32:17.530417 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:32:17.537998 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012028 Aug 06 20:32:17.538504 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Aug 6 20:32:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:32:17.550317 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-0abf30e7-c798-4d32-92dc-b0e7525ea1fe admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:32:17.557808 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-0abf30e7-c798-4d32-92dc-b0e7525ea1fe admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011048 Aug 06 20:32:17.558309 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Aug 6 20:32:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:35:15.642996 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:15.644027 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 06 20:35:15.644449 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:35:15.787049 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=6 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:15.941630 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:15.944069 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:35:15.944069 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 06 20:35:15.945169 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:15.945636 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:15.946057 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:15.946760 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:15.947209 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:15.947640 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:15.981818 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-f15f8192-1207-4136-a73c-7803738e696a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196233 Aug 06 20:35:15.982372 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 20:35:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:35:16.802397 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:16.803462 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 06 20:35:16.803861 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:35:16.994009 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:16.996616 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:35:16.996616 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 06 20:35:16.997748 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:16.998235 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:16.998661 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:16.999629 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:17.000074 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:17.000486 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:17.019180 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-ca9fa666-57f6-4d90-9688-ce661c1e4a3b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076638 Aug 06 20:35:17.019792 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 20:35:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:35:28.286721 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:28.287779 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 06 20:35:28.288170 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:35:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:35:28.430244 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell0:SELECT=4 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:28.430952 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_cell1:SELECT=4 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:28.431572 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG dbcounter [-] [103365] Writing DB stats nova_api:SELECT=8 {{(pid=103365) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:28.494720 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:28.497073 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:35:28.497073 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 06 20:35:28.498342 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:28.498779 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:28.499193 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:28.499944 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:28.500356 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:28.500763 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:28.526319 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-4cb13256-518d-4431-a59e-0e716caa747b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.100829 Aug 06 20:35:28.527163 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 20:35:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:35:29.364494 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: DEBUG nova.api.openstack.wsgi [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] Calling method '>' {{(pid=103366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:29.365484 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: INFO nova.api.openstack.requestlog [None req-043a259e-7008-47d6-a296-75f41393e314 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Aug 06 20:35:29.365872 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: [pid: 103366|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 20:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:35:29.553184 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG nova.api.openstack.wsgi [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Calling method '>' {{(pid=103365) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:35:29.555609 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:35:29.555609 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: warnings.warn(msg) Aug 06 20:35:29.556705 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:29.557295 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:29.557763 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:29.558481 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:35:29.558963 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:35:29.559408 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: DEBUG oslo_concurrency.lockutils [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103365) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:35:29.581426 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: INFO nova.api.openstack.requestlog [None req-71998754-efc0-4b82-9687-223b6dc7f142 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079127 Aug 06 20:35:29.581916 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: [pid: 103365|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 20:35:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:36:25.078158 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: Sat Aug 6 20:36:25 2022 - graceful shutdown triggered... Aug 06 20:36:25.077636 dv-cinder-851996-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 06 20:36:25.079123 dv-cinder-851996-5-iscsi devstack@n-api.service[103365]: Gracefully killing worker 1 (pid: 103365)... Aug 06 20:36:25.079543 dv-cinder-851996-5-iscsi devstack@n-api.service[103366]: Gracefully killing worker 2 (pid: 103366)... Aug 06 20:36:26.078663 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: worker 1 buried after 1 seconds Aug 06 20:36:26.078663 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: worker 2 buried after 1 seconds Aug 06 20:36:26.079361 dv-cinder-851996-5-iscsi devstack@n-api.service[103364]: goodbye to uWSGI. Aug 06 20:36:26.080574 dv-cinder-851996-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 06 20:36:26.081153 dv-cinder-851996-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 06 20:36:26.084911 dv-cinder-851996-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 20:36:26.095012 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:36:26 2022] *** Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: nodename: dv-cinder-851996-5-iscsi Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: machine: x86_64 Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: clock source: unix Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: pcre jit disabled Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: detected number of CPU cores: 4 Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: current working directory: / Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:36:26.096964 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: your processes number limit is 47680 Aug 06 20:36:26.097659 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: your memory page size is 4096 bytes Aug 06 20:36:26.097659 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: detected max file descriptor number: 2048 Aug 06 20:36:26.097659 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: lock engine: pthread robust mutexes Aug 06 20:36:26.097659 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: thunder lock: enabled Aug 06 20:36:26.097659 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 20:36:26.097659 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:36:26.136140 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: Python main interpreter initialized at 0x5576473029c0 Aug 06 20:36:26.136140 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: python threads support enabled Aug 06 20:36:26.136140 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: your server socket listen backlog is limited to 100 connections Aug 06 20:36:26.136140 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:36:26.136634 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:36:26.136634 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: *** Operational MODE: preforking *** Aug 06 20:36:26.136859 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:36:26.136859 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: spawned uWSGI master process (pid: 129457) Aug 06 20:36:26.137082 dv-cinder-851996-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 20:36:26.143289 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: spawned uWSGI worker 1 (pid: 129475, cores: 1) Aug 06 20:36:26.143289 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: spawned uWSGI worker 2 (pid: 129476, cores: 1) Aug 06 20:36:26.143289 dv-cinder-851996-5-iscsi devstack@n-api.service[129457]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:36:26.800596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:36:26.802935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 20:36:27.956767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:36:27.956767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: from cryptography.utils import int_from_bytes Aug 06 20:36:27.957530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:36:27.957530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: from cryptography.utils import int_from_bytes Aug 06 20:36:27.972758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:36:27.972758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: from cryptography.utils import int_from_bytes Aug 06 20:36:27.973430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:36:27.973430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: from cryptography.utils import int_from_bytes Aug 06 20:36:30.302275 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:36:30.303118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:36:30.303849 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:36:30.304221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:36:30.304478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:36:30.304867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.305194 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.305519 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.305842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.306182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.306483 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.306804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.307123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.307489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.307752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.308072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.308396 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-5-iscsi {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.308723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.309098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.309341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.309658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.310001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.310331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.310642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.311134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-5-iscsi {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.315990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.316382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.316382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.316766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.319736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.320024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.320731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.320731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.321069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.321225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.321466 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.321776 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.322105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.322423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.322745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.323000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.323268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.323594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.323913 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.324224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.324535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.324844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.325153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.325460 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.325768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.326075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.326382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.326700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.327017 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.327365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.327682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.328004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.328404 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.328655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.328966 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.329308 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.329625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.329938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.330510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.330831 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.331140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.331473 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.331797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.332104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.332441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.332795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.333170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.333479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.333788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.334105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.334412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.334721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.335030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.335362 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.335674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.335981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.336332 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.336595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.336905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.337211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.337520 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.337826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.338134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.338451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.338771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.339083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.339434 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.339745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.340053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.340374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.340681 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.340987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.341311 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.341619 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.341927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.342259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.342549 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.342889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.343174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.343498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.343820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.344142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.344413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.344721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.345025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.345331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.345635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.345941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.346242 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.346540 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.347346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.347346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.347686 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.347840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.350296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.350296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.350296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.350296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.350296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.350296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.351261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.351261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.351261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.351703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.351848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.352117 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.352443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.352764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.353075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.353390 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.353867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.354039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.354341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.354666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.354988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.355339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.355656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.355977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.356307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.356635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.356951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.357217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:36:30.357626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.357702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:36:30.357783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.357985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.358084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:36:30.358253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.358404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:36:30.358564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.358656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:36:30.358870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.359035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.359181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.359356 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.359502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.359726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.359883 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.360036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.360194 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.360349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.360507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.360669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.360823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.360982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.361127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.361273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.361417 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.361579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.361724 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.361868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.362019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.362190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.362355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.362531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-5-iscsi {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.362677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.362855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.363008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.363172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.363395 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.363544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.363706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.363866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.364564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.364739 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.364899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.365059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.365223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.365368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.365519 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.365519 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.365811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.365986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.366139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.366296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.366450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.366606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.366765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.366941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.367096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.367259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.367420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.369530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.369701 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.369905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.370064 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.370221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.370369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.370522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.370669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.370819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.370980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.371126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.371318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-5-iscsi {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.371479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.371625 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.371771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.371928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.372088 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.372088 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.372365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.372516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.372668 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.372826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.372979 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.373132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.373277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.373428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.373572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.373728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.373890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.374044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.374197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.375726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.376412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.376574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.376729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.376883 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.377041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.377196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.377349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.377494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.377666 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.377854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.378016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.378206 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.378394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.378567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.378738 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.378899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.379044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.379189 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.379432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.379586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.379731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.379989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.380758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.380913 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.381067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.381214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.381359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.381517 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.381663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.381811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.381961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.382108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.382268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.382435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.382587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.382740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.382893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.383040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.383192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.383371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.383518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.383662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.383813 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.383972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.384123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.384273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.384429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.384573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.384716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.384875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.385022 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.385172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.385327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.385472 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.385724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.385889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.386051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.386204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.386349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.386513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.386659 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.386813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.386972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.387118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.387280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.387440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.387588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.387732 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.387893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.388046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.388199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.388361 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.388515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.388661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.388819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.388971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.389116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.389259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.389403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.389562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.389707 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.389851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.390047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.390214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.391012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.391183 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.391370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.391528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.391674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.391827 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.391972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.392125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.392270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.392421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.392578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.392738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.392884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.393054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.393207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.393360 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.393513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.393659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.393812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.393970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.394126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.394272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.394427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.394580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.394734 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.394880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.395041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.395187 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.395356 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.395513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.395668 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.395820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.395975 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.396127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.396272 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.396423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.396578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.396731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.396877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.397929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.398134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.398293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.398429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.398576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.398772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.398916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.398995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.399074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.399159 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.399284 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.399379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.399459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.399538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.399615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.399694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.399778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.399863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.399947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.400125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400214 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.400305 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.400476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.400632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400701 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.400779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.400919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.400994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401065 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.401142 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.401288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.401690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.401845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.401934 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.402016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.402106 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.402188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.402269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.402357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.402447 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.402528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.402617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.402707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.402789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.402877 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.402968 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.403054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.403144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.403227 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.403899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:36:30.403978 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404814 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.404970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405271 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405347 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.405996 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.406114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.406240 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.406352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.406462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.407913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408582 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408837 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.408963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.409082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.409211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.409322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.409641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.409805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.409962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.410117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.410264 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.410409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.410564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.410711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.411419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.411568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.411721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.411868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412330 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412630 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.412927 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.413082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.413235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.413427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.413577 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.413740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.413910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.414078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.414249 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.414403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.414553 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.414706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.414865 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.415028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.415189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.415379 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.415543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.415707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.415860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416342 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416831 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.416983 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.417142 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.417295 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.417295 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.417595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.417747 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.417899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.418058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.418218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.418393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.418555 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.418716 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.418882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.419042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.419220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.419436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.419589 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.419751 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.419903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.420055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.420216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.420369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.420531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.420691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.420844 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421636 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.421946 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.422108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.422260 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.422412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.422573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.422812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.422979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.423133 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.423302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.423468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.423622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.423780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.423942 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.424094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.424247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.424406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.424586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.424747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.424912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.425065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.425225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.425378 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.425537 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.425690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.425945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.426120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.426285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.426528 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.427188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.427411 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.427576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.427736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.427889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.428994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.429153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.429315 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.429479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.429479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.429785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.430008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.430204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.430407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.430604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.430802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.430990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.431185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.431401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.431560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.431731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.431892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432045 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.432996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.433148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.433313 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.433473 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.433627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.433789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.433940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.434099 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.434261 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.434414 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.434572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.434733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.434894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.435061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.435222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.435409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.435563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.435715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.435884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.436050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.436222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.436383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.436536 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.436695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.436856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.437032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.437237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.437392 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.437543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.437694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.437862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.438034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.438196 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.438356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.438561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.438816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.439063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.439337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.439588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.439835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.439835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.440341 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.440619 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.440890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.441172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.441439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.441690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.441926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.442232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.442492 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.442767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.443028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.443310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.443598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.443857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.444092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.444337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.444594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.444836 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.445069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.445272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.445472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.445643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.445800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.445952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.446157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.446319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.446480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.446634 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.446807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.446970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.447207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.447438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.447633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.447850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.448028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.448189 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.448359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.448555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.448555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.448868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449208 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449364 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449683 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449683 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.449987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.450150 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.450318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.450473 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.450665 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.450850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.451027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.451229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.451472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.451626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.451778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.451941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.452094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.452256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.452256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.452547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.452547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.452851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453646 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.453978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.454139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.454299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.454452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.454604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.454762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.455016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.455615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.455784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.455958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.456127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.456283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.456450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.456611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.456773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.456927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.457094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.457899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.458068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.458223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.458389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.458563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.458717 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.458871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.459030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.459185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.459379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.459534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.459695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.459856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.460963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.461129 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.461284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.461443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.461596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.461756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.461919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.462083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.462236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.462388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.462549 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.462720 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.462953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.463185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.463402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.463558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.463718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.463879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.464042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.464209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.464363 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.464515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.464675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.464845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.465947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.466115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.466279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.466440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.466600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.466761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.466942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.467096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.467271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.467440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.467602 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.467765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.467918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.468070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.468230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.468391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.468545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.468707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.468878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.469033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.469192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.469354 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.469584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.469584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.469941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.470095 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.470247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.470407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.470560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.470725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.470879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.471049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.471202 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.471388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.471552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.471713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.471880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472033 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.472975 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.473148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.473823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.473994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.474156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.474315 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.474459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.474616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.474767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.474934 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.475990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476332 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476415 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.476935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477100 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477343 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.477958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478133 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478378 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478468 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478551 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.478988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479817 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.479907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480001 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480265 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.480764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.481434 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.481550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.481649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.481743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.481830 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.481920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482095 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482187 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.482898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.483104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.483204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.483461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.483562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.483783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.483881 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.484106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.484206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.484413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.484504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.484718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.484822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.485946 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.486958 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.487162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.487324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.487501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.487606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.487805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.487903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.488125 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.488216 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.488433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.488524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.488737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.488839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.489619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.489731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.489945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.490045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.490266 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.490365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.490579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.490689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.490941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491651 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.491969 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.492196 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.492287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.492511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.492610 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.492822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.492928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.493136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.493226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.493457 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.493562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.493774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.493873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.494082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.494180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.494399 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.494504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.494712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.494803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.495025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.495123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.495369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.495617 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.495711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.495954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.496057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.496275 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.496364 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.496583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.496672 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.496903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497033 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497871 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.497982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.498181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.498286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.498530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.498850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.499181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.499446 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.499607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.499970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.500292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.500666 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.500987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.501578 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.501943 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.502204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.502435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.502556 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.502785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.502995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.503115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.503228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.503487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.503741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.503888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.504068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.504203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.504404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.504560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.504761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.504976 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.505110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.505240 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.505383 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.505522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.505706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.505858 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.506041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.506175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.506369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.506496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.506695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.506829 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.507030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.507164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.507394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.507713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.508032 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.508252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.508394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.508592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.508733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.508924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.509068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.509255 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.509397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.509588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.509729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.509911 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.510053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.510236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.510371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.510561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.510695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.510882 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.511025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.511228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.511398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.511695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.511832 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.512030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.512164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.512354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.512494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.512671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.512804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513010 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.513937 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.514075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.514250 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.514397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.514571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.514714 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.514883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.515018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.515262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.515410 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.515585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.515732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.515915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.516055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.516235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.516367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.516545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.516691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.516871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.517007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.517184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.517319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.517533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.517719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.517861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.518073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.518264 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.518405 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.518588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.518730 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.518914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.519047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.519237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.519388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.519572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.519709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.519889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.520022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.520236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.520381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.520574 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.520710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.520890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521214 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.521938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.522119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.522266 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.522432 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.522579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.522740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.522873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.523053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.523200 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.523389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.523521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.523700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.523900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.524044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.524224 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.524359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.524545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.524678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.524876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525189 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.525945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.526110 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.526250 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.526425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.526558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.526730 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.526941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527376 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.527984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.528126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.528295 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.528429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.528602 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.528736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.528925 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.529068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.529234 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.529389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.529656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.529792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.529923 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530054 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.530967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.531140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.531359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.531516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.531658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.531833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.531960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.532195 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.532365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.532492 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.532700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.532840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.533022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.533165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.533357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.533491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.533690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.533891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534446 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.534897 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.535031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.535235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.535402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.535542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.535673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.536345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.536501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.536659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.536785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.536973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.537114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.537286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.537430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.537599 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.537734 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.537910 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.538044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.538223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.538365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.538534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.538675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.538960 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539107 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539686 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539825 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.539955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.540093 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.540237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.540428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.540571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.540750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.540890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.541069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.541202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.541387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.541514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.541705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.541839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542142 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.542950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.543090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.543285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.543421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.543618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.543769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.543935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.544067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.544241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.544374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.544554 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.544695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.544864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545176 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545617 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.545944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.546122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.546249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.546451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.546585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.546773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.546906 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.547084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.547224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.547421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.547552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.547723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.547864 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.548070 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.548203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.548382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.548523 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.548710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.548842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549782 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.549952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.550098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.550272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.550412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.550591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.550723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.550896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.551038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.551200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.551359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.552120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.552266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.552419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.552550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.552730 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.552864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.553038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.553172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.553344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.553480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.553654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.553925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554250 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.554984 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.555162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.555332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.555555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.555696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.555826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.555964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.556126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.556260 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.556431 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.556572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.556735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.556876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.557040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.557175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.557342 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.557475 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.557671 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.557804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.558956 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.559090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.559370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.559508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.559699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.559848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.560985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.561119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.561306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.561438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.561618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.561750 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.561930 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562254 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562849 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.562983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.563161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.563308 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.563502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.563644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.563824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.563974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.564138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.564279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.564465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.564606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.564784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.564918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.565105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.565319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.565452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.565583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.565715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.565852 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.566040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.566180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.566349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.566568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.566703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.566900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.567082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.567291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.567456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.567657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.567792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.567990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.568138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.568318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.568452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.568643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.568787 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.568980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.569124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.569296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.569431 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.569610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.569744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.569929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.570074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.570239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.570380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.570547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.570687 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.570878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.571014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.571199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.571361 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.571537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.571678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.571865 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.572008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.572184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.572318 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.572500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.572729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.572872 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.573089 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.573199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.573341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:36:30.573482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.573733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.574068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.574396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.574711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.575043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.575384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.575704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.576028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.576348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.576663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.577275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.577275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.577604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.577918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.578239 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.578552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.578890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.579203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.579542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.579857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.580437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.580751 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.581064 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.581419 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.581712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.582099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.582306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.582622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.582981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.583477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.583626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.583938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.584252 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.584594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.584912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.585276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.585608 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.585930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.586261 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.586637 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.586913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.587368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.587633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.588235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.588577 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.588906 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.589254 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.589592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.589908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.590223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.590537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.590872 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.591193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.591575 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.591855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.592171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.592490 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.592811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.593133 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.593452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.593770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.594103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.594407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.594772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.595044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.595385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.595796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.596082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.596415 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.596744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.597069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.597515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.597785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.598025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.598884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.599202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.599991 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.599991 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.600250 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.600485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.600930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.601253 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.601581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.601996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.602714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.602714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.603115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.603290 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.603530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.603849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.604188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.604538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.604875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.605210 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.605527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.605842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.606156 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.606474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.606802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.607117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.607459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.607772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.608102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.608385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.608700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.609011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.609321 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.609635 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.609945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.610255 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.610565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.610874 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.611182 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.611539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.611864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.612175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.612485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.612794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.613105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.613411 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.614175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.614502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.614831 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.615152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.615508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.615826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.616155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.616485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.616811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.617127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.617476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.617798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.618121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.618439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.618757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.619077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.619430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.619775 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.620110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.620423 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.620759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.621086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.621417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.621743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.622066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.622405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.622722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.623043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.623390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.623712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.624034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.624360 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.624680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.625000 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.625326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.625651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.625990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.626325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.626645 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.626977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.627337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.627702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.628028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.628384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.628722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.629046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.629367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.630215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:36:30.630466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:36:30.725728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO dbcounter [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Registered counter for database nova_api Aug 06 20:36:30.746878 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_db.sqlalchemy.engines [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:30.754093 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writer thread running {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:30.784018 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO dbcounter [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Registered counter for database nova_api Aug 06 20:36:30.804251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_db.sqlalchemy.engines [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:30.810841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writer thread running {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:30.811279 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.context [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbdc6e2-4490-4e80-be96-0962cc011caf(cell1) {{(pid=129476) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:36:30.815417 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:36:30.815904 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:36:30.817475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:36:30.818207 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:36:30.818664 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:36:30.820691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:36:30.822688 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO dbcounter [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Registered counter for database nova_cell0 Aug 06 20:36:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO dbcounter [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Registered counter for database nova_cell1 Aug 06 20:36:30.835174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_db.sqlalchemy.engines [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:30.836990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_db.sqlalchemy.engines [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:30.842886 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writer thread running {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:30.844997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writer thread running {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:30.868731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.context [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbdc6e2-4490-4e80-be96-0962cc011caf(cell1) {{(pid=129475) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 20:36:30.872831 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:36:30.873317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:36:30.874896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:36:30.875669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:36:30.876129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:36:30.878138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:36:30.880711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO dbcounter [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Registered counter for database nova_cell0 Aug 06 20:36:30.884762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO dbcounter [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Registered counter for database nova_cell1 Aug 06 20:36:30.892104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_db.sqlalchemy.engines [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:30.894687 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_db.sqlalchemy.engines [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:30.899422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writer thread running {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:30.902017 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writer thread running {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:30.990379 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO dbcounter [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Registered counter for database nova_cell0 Aug 06 20:36:30.996952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_db.sqlalchemy.engines [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:31.001412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writer thread running {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:31.052433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO dbcounter [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Registered counter for database nova_cell0 Aug 06 20:36:31.059436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_db.sqlalchemy.engines [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:36:31.063828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writer thread running {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:36:31.332539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: WARNING keystonemiddleware.auth_token [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:36:31.340337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: WARNING keystonemiddleware.auth_token [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:36:31.389603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: WARNING keystonemiddleware.auth_token [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:36:31.397045 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: WARNING keystonemiddleware.auth_token [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:36:31.688048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: WARNING keystonemiddleware.auth_token [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:36:31.694282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: WARNING keystonemiddleware.auth_token [None req-6d676d03-3be6-4964-b8a4-b88b5acad7f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:36:31.701347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576473029c0 pid: 129476 (default app) Aug 06 20:36:31.749337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: WARNING keystonemiddleware.auth_token [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 20:36:31.756002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: WARNING keystonemiddleware.auth_token [None req-4e9bd896-70b1-4996-b586-7a5bb248f201 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 20:36:31.762160 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576473029c0 pid: 129475 (default app) Aug 06 20:37:10.261347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c9f67e79-f308-4998-92d1-f0e6b50a6923 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba9800f940>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:10.300622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.302070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.303523 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.304610 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:11.278139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c9f67e79-f308-4998-92d1-f0e6b50a6923 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/a67365ae-f59a-4794-81b5-52817c773e98" status: 200 len: 350 microversion: 2.1 time: 1.415991 Aug 06 20:37:11.279146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 1/1] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:37:09 2022] GET /compute/v2.1/os-volumes/a67365ae-f59a-4794-81b5-52817c773e98 => generated 350 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:14.676289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:14.678148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:14.680562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:14.683842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:15.193333 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9b73d294-364a-407c-9873-8c25064d26ff tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97fac940>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:16.392639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9b73d294-364a-407c-9873-8c25064d26ff tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0f40d6ab-c377-4d63-9393-a01d1c686016" status: 200 len: 350 microversion: 2.1 time: 1.722685 Aug 06 20:37:16.394043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 1/2] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:37:14 2022] GET /compute/v2.1/os-volumes/0f40d6ab-c377-4d63-9393-a01d1c686016 => generated 350 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:18.139901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1342948447", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "networks": [{"uuid": "1602694c-757d-4404-a551-a319d30f5fe3"}]}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:18.362901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] validate_networks() for [('1602694c-757d-4404-a551-a319d30f5fe3', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:37:19.756450 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:37:19.757056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:37:19.757502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:37:19.757924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:37:19.758340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:37:19.782068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:19.782567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:19.783005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:19.784336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:19.785058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:19.786782 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:19.836935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Getting quotas for project a780800618e549c6b01ef67dd64333c4. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:19.845954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Getting quotas for user d39e95dd7b6e4055842699bbc54c39f5 and project a780800618e549c6b01ef67dd64333c4. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:19.871176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:37:19.874696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:37:20.109797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-62794e1c-564f-4857-9cc1-03eb2232ded9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.578859 Aug 06 20:37:20.110695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:37:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:37:20.123993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6116f70b-6397-4493-ba2d-deb09e13a092 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:20.125370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6116f70b-6397-4493-ba2d-deb09e13a092 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:20.323595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6116f70b-6397-4493-ba2d-deb09e13a092 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:20.359112 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6116f70b-6397-4493-ba2d-deb09e13a092 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1215 microversion: 2.1 time: 0.239815 Aug 06 20:37:20.363459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:20 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:21.383917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f04c5a26-6cd2-47c8-bd43-0c83619ea23d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:21.384694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f04c5a26-6cd2-47c8-bd43-0c83619ea23d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:21.621548 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f04c5a26-6cd2-47c8-bd43-0c83619ea23d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:21.643103 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f04c5a26-6cd2-47c8-bd43-0c83619ea23d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1215 microversion: 2.1 time: 0.264778 Aug 06 20:37:21.654076 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 3/5] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:21 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:21.988083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-73ed9545-c133-45ab-91f8-a8ed7017b512 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: .version_select at 0x7fba97dde430>, body: {"keypair": {"name": "tempest-keypair-1096327027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzDuOlt7ynMQ5fzk3857uIoj7pMN5bRldrhYwsy26nF8nU5wYfEWJhszjqV3EMTm8LZGBS/0alf7/OFFVzuvXLGvFGrQygqWC6LOD0/FzSrzOfX6eIyOE/zjp4Jq2da/A=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:22.140998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-73ed9545-c133-45ab-91f8-a8ed7017b512 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for project 9193df5e4d39448c947cfbb3139306bf. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:22.149837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-73ed9545-c133-45ab-91f8-a8ed7017b512 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for user 86090cd4247d4d598eb1976f4224b4f3 and project 9193df5e4d39448c947cfbb3139306bf. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:22.337379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-73ed9545-c133-45ab-91f8-a8ed7017b512 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.696319 Aug 06 20:37:22.344069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 3/6] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:37:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:22.673937 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:22.674597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:22.691317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:22.691841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:22.698043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:22.699440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:22.711334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:22.712108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:23.343476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:23.384526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6290f5fc-2113-4a0b-93af-f3d0a12985d1 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1219 microversion: 2.1 time: 0.714337 Aug 06 20:37:23.393423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:22 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1219 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:23.912178 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e078c4dc-0df7-46f1-b28e-775fe710363b tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d09670>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:24.047760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e078c4dc-0df7-46f1-b28e-775fe710363b tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/3857582e-c1f4-4e93-9ff8-a56fb7ddf65d" status: 200 len: 351 microversion: 2.1 time: 0.139685 Aug 06 20:37:24.048867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:37:23 2022] GET /compute/v2.1/os-volumes/3857582e-c1f4-4e93-9ff8-a56fb7ddf65d => generated 351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:24.062008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c9d4cc79-3f9a-4646-b397-0be9651d879c tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba96c00280>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:24.230662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c9d4cc79-3f9a-4646-b397-0be9651d879c tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.173232 Aug 06 20:37:24.232329 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Aug 6 20:37:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:24.248685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8e026b31-9e15-4a3e-bd7f-5a57ce7a2bf3 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d09c10>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:24.405019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:24.405646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:24.409894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8e026b31-9e15-4a3e-bd7f-5a57ce7a2bf3 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165618 Aug 06 20:37:24.411702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 5/10] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Aug 6 20:37:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:24.424208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:24.425498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:24.426107 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:24.426974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:24.427603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:24.428174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:24.428635 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-575b07c2-1d60-44e6-b3d4-1d9e68e2f76c tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d09ee0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:24.709781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-575b07c2-1d60-44e6-b3d4-1d9e68e2f76c tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.286089 Aug 06 20:37:24.711091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 6/11] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Aug 6 20:37:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:24.729538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0ba966f1-998e-46af-ae72-06c306651da3 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d1d700>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:25.110943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0ba966f1-998e-46af-ae72-06c306651da3 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.385249 Aug 06 20:37:25.111544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 7/12] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Aug 6 20:37:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:37:25.126689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8ca96c97-4093-40ed-a148-5c54c4a36245 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d2b790>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:25.174164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:25.212475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-162d02c7-216d-4476-952a-4c2be539c251 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1275 microversion: 2.1 time: 0.810141 Aug 06 20:37:25.234258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:24 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1275 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:25.419617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8ca96c97-4093-40ed-a148-5c54c4a36245 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.296436 Aug 06 20:37:25.429953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 8/14] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Aug 6 20:37:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:25.444452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-22841ff1-d2ad-436e-9c81-dbb2b486e5b7 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d64d30>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:25.589557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-570917730", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:25.706997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] validate_networks() for [('3075084b-9df5-48ff-a5de-f7239377ed1b', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:37:25.717996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-22841ff1-d2ad-436e-9c81-dbb2b486e5b7 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.280537 Aug 06 20:37:25.718973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 9/15] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Aug 6 20:37:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:25.738499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bcd7bb28-6e1e-4dbe-a4c0-5848848d34c2 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d77ee0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:25.964067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bcd7bb28-6e1e-4dbe-a4c0-5848848d34c2 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.230523 Aug 06 20:37:25.965419 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 10/16] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Aug 6 20:37:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:25.982294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eaa43c0f-448d-4044-adc3-66f9f64ff2e1 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] Calling method '.version_select at 0x7fba97d27670>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:26.220881 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eaa43c0f-448d-4044-adc3-66f9f64ff2e1 tempest-VolumesTestJSON-828748561 tempest-VolumesTestJSON-828748561-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.243725 Aug 06 20:37:26.223034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 11/17] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Aug 6 20:37:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:26.816420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-340d37b8-dc6c-482d-b5bb-52de7b9b01c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: .version_select at 0x7fba97d09e50>, body: {"keypair": {"name": "tempest-keypair-1144500751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSRz988ypB/zZ+DKf303Fhdm8kjzWuzLH+yD3HIuDmOSZCykO7PdZXUKC2e4c5sJRa7WCaumMH6WzHBLVgP4BqbZ6qhJUX1vwZzgkogtP6VD6nu7O5iLPrdsZD0mlYvCw=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:26.912601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-340d37b8-dc6c-482d-b5bb-52de7b9b01c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:26.932061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-340d37b8-dc6c-482d-b5bb-52de7b9b01c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:27.047477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-340d37b8-dc6c-482d-b5bb-52de7b9b01c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.817882 Aug 06 20:37:27.051558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 12/18] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:37:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:27.082909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:27.098826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:27.148897 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:27.152617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:27.153832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:27.157392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:27.158076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:27.160461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:27.923099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:27.985901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bd2f5117-989f-40d2-9ac2-046d66f6ba90 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1273 microversion: 2.1 time: 0.928100 Aug 06 20:37:28.000042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 13/19] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:27 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1273 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:29.014793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:29.016237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:29.043999 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:29.049184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:29.053423 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:29.061655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:29.065103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:29.069012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:29.812433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:30.030088 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:30.044939 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b1946ec1-5117-4c5d-9be9-0d13781d4cc8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1273 microversion: 2.1 time: 1.038419 Aug 06 20:37:30.045538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 14/20] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:29 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1273 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:30.060118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:37:30.060440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:37:30.061271 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:37:30.061846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:37:30.062633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:37:30.090234 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:30.094369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:30.094995 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:30.096798 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:30.097439 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:30.099579 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:30.149446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:30.168182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for user 919c94bd42144c9b86fd9977e85b0762 and project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:30.193269 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:37:30.199836 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:37:30.331728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f0687896-4a81-4308-a3b6-873c24488d0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.014993 Aug 06 20:37:30.339405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9ff92670-9dc5-46b8-92dd-c4a219931fbb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:30.340794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9ff92670-9dc5-46b8-92dd-c4a219931fbb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:30.353727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 7/21] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:37:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 5043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:37:30.805560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9ff92670-9dc5-46b8-92dd-c4a219931fbb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:30.836968 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9ff92670-9dc5-46b8-92dd-c4a219931fbb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1221 microversion: 2.1 time: 0.498998 Aug 06 20:37:30.841703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 15/22] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:30 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1221 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:31.074386 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:31.075729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:31.100639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:31.100639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:31.100639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:31.100639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:31.101214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:31.101214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:31.325404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1005903619", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:31.552005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] validate_networks() for [('3075084b-9df5-48ff-a5de-f7239377ed1b', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:37:33.317939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:33.325755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-84372532-1f04-4699-a17f-c319c1a800fd tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 2.261203 Aug 06 20:37:33.336794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 8/23] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:31 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:33.353223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1207965011", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "978da649-b201-4052-9259-dabfd9448731"}], "security_groups": [{"name": "tempest-securitygroup--1642069152"}], "key_name": "tempest-keypair-1096327027", "user_data": "}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:33.861325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] validate_networks() for [('978da649-b201-4052-9259-dabfd9448731', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:37:36.664110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:37:36.664698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:37:36.665130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:37:36.665581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:37:36.666295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:37:36.693789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:36.695047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:36.697744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:36.699280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:36.699835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:36.700358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:36.753651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:36.768785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for user 919c94bd42144c9b86fd9977e85b0762 and project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:36.785339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:37:36.793227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:37:36.965399 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ff8793cd-9445-4178-b414-32c7c15c5988 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.646713 Aug 06 20:37:36.967929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 16/24] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:37:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 5649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:37:37.007451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1110476415", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "204900d1-dea4-474e-a19d-da292c4d4d6a"}], "security_groups": [{"name": "tempest-securitygroup--1239229534"}], "key_name": "tempest-keypair-1144500751", "user_data": "}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:38.418729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:37:38.419381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:37:38.419945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:37:38.420559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:37:38.421126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:37:38.450746 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:38.454527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:38.455087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:38.458216 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:38.458216 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:38.465264 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:38.544767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for project 9193df5e4d39448c947cfbb3139306bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:38.562042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for user 86090cd4247d4d598eb1976f4224b4f3 and project 9193df5e4d39448c947cfbb3139306bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:38.610550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:37:38.616433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:37:38.718569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] validate_networks() for [('204900d1-dea4-474e-a19d-da292c4d4d6a', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:37:38.763753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3409c031-e228-4c14-bc66-7e53d29e9148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.426939 Aug 06 20:37:38.765374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 9/25] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:37:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 5429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:37:38.793155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:38.794838 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:38.837465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:38.840099 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:38.842057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:38.852641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:38.854725 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:38.855763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:41.184831 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:41.192792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=29 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:41.195382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-70a840b7-cdab-4896-b62e-4967416169f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 2.425020 Aug 06 20:37:41.208580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 10/26] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:38 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:41.225030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:41.243278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:41.245484 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=9 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:41.264670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:41.265258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:41.265733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:41.266487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:41.266879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:41.267721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:41.828727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:41.845384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-887a1d7a-e198-4bac-84fd-a33f8b762c83 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1280 microversion: 2.1 time: 0.635455 Aug 06 20:37:41.847919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 11/27] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:41 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1280 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:41.853577 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:41.867437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:41.881994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:41.882420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:41.882857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:41.883586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:41.905981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:41.906440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.177101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:42.186257 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8ae96bc6-0b06-4a93-a13a-8930c9ab70af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1308 microversion: 2.1 time: 0.336208 Aug 06 20:37:42.195077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 12/28] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:41 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:42.226246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:42.227427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:42.245681 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.246469 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.247133 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.248096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.251745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.253388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.487025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:37:42.488738 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:37:42.489402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:37:42.489895 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:37:42.490301 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:37:42.501789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.503348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.503796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.504713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.505299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.505737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.527607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:37:42.535440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:37:42.546607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:37:42.549564 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:37:42.618866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-df2778aa-2489-41fd-9743-8e767392aa5f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.649674 Aug 06 20:37:42.620135 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 17/29] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:37:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 5651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:37:42.735585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2255f05a-c9a7-4116-8c52-3cc2273ccae5", "tag": "d8634471-c27b-4ee6-bf62-7f94cd7dbbdf"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:42.751136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.752449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.754653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.780805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Creating event network-changed:d8634471-c27b-4ee6-bf62-7f94cd7dbbdf for instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 on hv-cinder-85199 Aug 06 20:37:42.781355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 20:37:42.781753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-593f6162-e3c2-4f52-849b-914e8ee5d060 req-4fd0f916-1221-40c4-b763-b01b91322b14 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 20:37:42.782777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.783291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.783887 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.785538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.787225 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.787974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.800125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:42.803619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.compute.rpcapi [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 20:37:42.804694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] Releasing lock "compute-rpcapi-router" {{(pid=129475) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 20:37:42.807740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-425ebe5b-c251-4235-8f16-45f3d3681a2d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.585507 Aug 06 20:37:42.810697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 13/30] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:42 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:42.826019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-957d4105-f914-4b36-a9e5-923998ce0383 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:42.826741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-957d4105-f914-4b36-a9e5-923998ce0383 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:42.847045 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8aa64185-9d38-4883-8cfe-fe1b669961fa None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225524 Aug 06 20:37:42.847897 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 18/31] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:42.871076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:42.873245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:42.882268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.883193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.884131 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:42.885236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:42.886644 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:42.887175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:43.188054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-957d4105-f914-4b36-a9e5-923998ce0383 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:43.192609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=21 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:43.200392 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-957d4105-f914-4b36-a9e5-923998ce0383 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1242 microversion: 2.1 time: 0.388222 Aug 06 20:37:43.201348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 14/32] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:42 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1242 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:43.214372 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:43.214980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:43.230773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:43.231579 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:43.232174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:43.235210 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:43.235988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:43.236754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:43.404069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:43.418694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2074e95c-ba8f-454d-9377-8b39dd1920f7 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1296 microversion: 2.1 time: 0.208163 Aug 06 20:37:43.419751 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 15/33] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:43 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1296 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:43.501516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:43.508910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b071c46f-edc3-4e69-adf9-4861a110189c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.643755 Aug 06 20:37:43.509601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 19/34] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:42 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:43.829863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:43.830862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:43.842330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:43.842903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:43.843409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:43.844125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:43.844584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:43.847764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.018606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:44.036814 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-eac80f89-b678-4c63-bb7c-fdc4fa647654 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.210652 Aug 06 20:37:44.050945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 16/35] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:43 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:44.236821 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:44.238703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:44.246084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.246785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.247647 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.248715 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.249440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.250118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.408501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:44.419796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ac8f4d07-25ff-42ce-ac82-e9530691d019 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1246 microversion: 2.1 time: 0.189437 Aug 06 20:37:44.446698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:44.447346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:44.453017 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 20/36] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:44 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1246 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:44.455892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.456596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.457222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.458716 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.459464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.460638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.534237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:44.535281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:44.542307 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.543689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.544367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.545477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.546257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.546912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.604997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:44.617075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3d68df56-5422-4857-88b5-677fd775200f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1296 microversion: 2.1 time: 0.180124 Aug 06 20:37:44.617529 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 17/37] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:44 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1296 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:44.877004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d", "tag": "6fce6b6f-cd73-4f5c-9c57-051221c987e2"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:44.898969 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.899911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.900306 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.949571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Creating event network-changed:6fce6b6f-cd73-4f5c-9c57-051221c987e2 for instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d on hv-cinder-85199 Aug 06 20:37:44.950089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=129476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 20:37:44.950479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3f46433c-c6e2-46be-96db-dc0c8b138c80 req-082de286-f4c5-405f-b8a5-14318282893c service nova] Acquired lock "compute-rpcapi-router" {{(pid=129476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 20:37:44.951574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.952039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.952467 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.953181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:44.953631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:44.954051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:44.976685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.compute.rpcapi [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 20:37:44.977600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] Releasing lock "compute-rpcapi-router" {{(pid=129476) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 20:37:45.014637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-95f00ebf-b9c9-4108-a4eb-8f8e03764c7c None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141212 Aug 06 20:37:45.015574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 18/38] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:45.059157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:45.060334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:45.068566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:45.069061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:45.069500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:45.070209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:45.070670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:45.071092 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:45.086667 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:45.107983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-081a39f3-0b10-4851-b2ff-38a7aaab6ff7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.579525 Aug 06 20:37:45.111483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 21/39] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:44 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:45.449889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:45.450631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:45.453890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:45.466024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:45.469067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:45.470777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:45.472924 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:45.473489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:45.474112 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:45.482119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:45.490774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d257651e-e503-4c35-91c1-aefb2e12f085 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.435630 Aug 06 20:37:45.507101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 19/40] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:45 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:45.601600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:45.612395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6465ff6f-5f86-4fa5-8036-beea7e31123e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1302 microversion: 2.1 time: 0.167794 Aug 06 20:37:45.613916 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 22/41] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:45 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1302 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:45.638404 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:45.639682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:45.646786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:45.647221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:45.647874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:45.648859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:45.649314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:45.649736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:45.743717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:45.751501 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3f33ddc4-9671-43f1-ad0b-c4390e7e3c2b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1296 microversion: 2.1 time: 0.117291 Aug 06 20:37:45.753169 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 20/42] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:45 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:46.136595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:46.137437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:46.149373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.150248 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.150772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.152286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.154734 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.155835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.402196 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:46.415636 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e352c480-6947-4d76-a6b6-792cbbc81a68 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.283194 Aug 06 20:37:46.419972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:46 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:46.514357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:46.515384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:46.529303 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.530389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.530896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.533502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.534145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.534648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.633954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:46.634686 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:46.644861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.647912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.652167 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.654368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.657582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.658150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.759987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:46.770370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eec9e850-208f-408b-ba02-40cfdba81549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1302 microversion: 2.1 time: 0.140044 Aug 06 20:37:46.771398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 24/44] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:46 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1302 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:46.805841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:46.820544 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-921c3f87-4bbb-4683-ad99-3070616465cc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.310508 Aug 06 20:37:46.821957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 21/45] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:46 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:46.840346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:46.841297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:46.851951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.852656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.853242 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:46.854721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:46.855338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:46.855988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.020450 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:47.028163 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-05b83655-5a8e-4ad0-9870-584a7ce777f5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.202607 Aug 06 20:37:47.029061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 22/46] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:46 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:47.055065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-66f32a0d-607f-4db9-8e66-639736d1aebb req-2f7bcdbc-b2d9-4f40-a78d-3ad25418ae4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7e3d25-df60-4e49-9e80-4378cc82513f", "tag": "29dc41a1-2bf2-42c4-a80a-e612ddfd232f"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:47.066104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-66f32a0d-607f-4db9-8e66-639736d1aebb req-2f7bcdbc-b2d9-4f40-a78d-3ad25418ae4c service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.066890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-66f32a0d-607f-4db9-8e66-639736d1aebb req-2f7bcdbc-b2d9-4f40-a78d-3ad25418ae4c service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.067544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-66f32a0d-607f-4db9-8e66-639736d1aebb req-2f7bcdbc-b2d9-4f40-a78d-3ad25418ae4c service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.080863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-66f32a0d-607f-4db9-8e66-639736d1aebb req-2f7bcdbc-b2d9-4f40-a78d-3ad25418ae4c service nova] Creating event network-changed:29dc41a1-2bf2-42c4-a80a-e612ddfd232f for instance 8d7e3d25-df60-4e49-9e80-4378cc82513f on hv-cinder-85199 Aug 06 20:37:47.085787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-66f32a0d-607f-4db9-8e66-639736d1aebb req-2f7bcdbc-b2d9-4f40-a78d-3ad25418ae4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313070 Aug 06 20:37:47.086393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 25/47] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:47.440108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:47.441084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:47.449646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.450582 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.451610 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.452861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.453406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.453901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.661241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:47.672860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-10af07f7-c0df-4e72-ae13-2073351fa87a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.236218 Aug 06 20:37:47.688077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:47 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:47.793757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:47.794511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:47.810119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.811149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.811912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.813914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.815396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.816037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.843980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:47.845090 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:47.864126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.864839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.865457 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:47.866315 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:47.866921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:47.867565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:48.307872 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:48.319181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-be11626d-ed86-4f05-ae14-5475c4b1a2d9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1302 microversion: 2.1 time: 0.531285 Aug 06 20:37:48.321800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 26/49] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:47 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1302 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:48.329900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:48.331382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:48.351559 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:48.352069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:48.352651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:48.357037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:48.357573 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:48.358185 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:48.746224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:48.754161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ebdc682d-8e46-4e22-a10e-f19cc3a91018 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.915236 Aug 06 20:37:48.757075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 24/50] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:47 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:48.766685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:48.768165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:48.785540 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:48.786266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:48.786892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:48.787870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:48.788538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:48.789281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:49.620699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:49.631347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f42822a1-3455-4cc1-9364-ebe0676aeee6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.872497 Aug 06 20:37:49.634174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 25/51] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:48 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:49.644034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:49.645775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:49.653177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:49.661358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0fc66142-abe0-4d9b-82cf-1067d5133f85 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 1.338289 Aug 06 20:37:49.667690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 27/52] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:48 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:49.674566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:49.675063 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:49.683612 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:49.685061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:49.688038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:49.688608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:49.775025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:49.776046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:49.788128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:49.789529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:49.791792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:49.795878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:49.796863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:49.798475 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:50.059519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:50.070879 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-326150fa-33da-4c03-84a5-73bdd90459d9 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.300044 Aug 06 20:37:50.072023 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 28/53] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:49 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:50.076879 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-b74e02db-fecd-4b8e-9da9-2fe070305481 req-bf099868-8971-4d1e-b5ce-d7c4700866e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72752a0b-3b0b-428e-b578-4958b8a51a1b", "tag": "3533274d-9341-439a-8e8f-6ff119c5b8e3"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:50.087747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-b74e02db-fecd-4b8e-9da9-2fe070305481 req-bf099868-8971-4d1e-b5ce-d7c4700866e6 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:50.088582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-b74e02db-fecd-4b8e-9da9-2fe070305481 req-bf099868-8971-4d1e-b5ce-d7c4700866e6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:50.089255 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-b74e02db-fecd-4b8e-9da9-2fe070305481 req-bf099868-8971-4d1e-b5ce-d7c4700866e6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:50.099882 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:50.104292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-b74e02db-fecd-4b8e-9da9-2fe070305481 req-bf099868-8971-4d1e-b5ce-d7c4700866e6 service nova] Creating event network-changed:3533274d-9341-439a-8e8f-6ff119c5b8e3 for instance 72752a0b-3b0b-428e-b578-4958b8a51a1b on hv-cinder-85199 Aug 06 20:37:50.109913 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f31be127-d27f-48fe-aa4d-56d1e5f864da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.472932 Aug 06 20:37:50.116671 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 26/54] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:49 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:50.118810 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-b74e02db-fecd-4b8e-9da9-2fe070305481 req-bf099868-8971-4d1e-b5ce-d7c4700866e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045191 Aug 06 20:37:50.119748 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 29/55] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:50.656863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:50.658614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:50.666199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:50.666700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:50.667142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:50.668145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:50.668624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:50.669060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:50.688161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:50.688990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:50.695372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:50.696128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:50.697019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:50.698244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:50.698722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:50.699157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:50.917107 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:50.922719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:50.937036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f614997f-2fda-4255-9e54-540aa5f0b20c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.286246 Aug 06 20:37:50.940013 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 27/56] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:50 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:50.943276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-94d2397b-cafc-4bd3-a13a-54f0a1bf52f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.255362 Aug 06 20:37:50.949084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 30/57] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:50 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:51.094529 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:51.095156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:51.103199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:51.103807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:51.107927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:51.110023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:51.112570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:51.113421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:51.141263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:51.143514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:51.154821 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:51.155791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:51.156310 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:51.157262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:51.157828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:51.158932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:51.388266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:51.395179 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.397505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9c235254-d865-4219-89a1-e7bee2f5b547 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.306918 Aug 06 20:37:51.400123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 28/58] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:51 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:51.438503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:51.448610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3df1763b-b17c-481a-84bf-6da3d799aba2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.310827 Aug 06 20:37:51.449405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 31/59] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:51 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:51.983472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:51.985661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:51.986967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:51.988534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:52.002458 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:52.002956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:52.008734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:52.009500 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:52.010955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:52.011562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:52.012213 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:52.013609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:52.014903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:52.019061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:52.019778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:52.020395 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:52.543403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=24 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.803026 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.937444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:52.963401 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:52.968005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-18993214-a308-418a-a606-1abe558e3986 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.994694 Aug 06 20:37:52.971429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 32/60] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:51 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:52.971974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0375cedd-f0ab-44aa-817d-946894e0d3db tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 1.000051 Aug 06 20:37:52.978938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:52.980899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:52.984811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 29/61] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:51 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:53.000067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.001350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-5e18bb8c-3e89-42a5-ae26-e6ecb9c6b60a req-92ae1050-a1dd-4236-8367-2f2bee6a69a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46acb22e-5b82-4d53-adae-81e616c05c32", "tag": "1e3edbbc-c6e8-46ad-99c0-ad3fc7356693"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:53.002513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.004598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.005697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.008372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.010168 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.026537 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5e18bb8c-3e89-42a5-ae26-e6ecb9c6b60a req-92ae1050-a1dd-4236-8367-2f2bee6a69a5 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.029383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5e18bb8c-3e89-42a5-ae26-e6ecb9c6b60a req-92ae1050-a1dd-4236-8367-2f2bee6a69a5 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.029819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5e18bb8c-3e89-42a5-ae26-e6ecb9c6b60a req-92ae1050-a1dd-4236-8367-2f2bee6a69a5 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.047907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.091359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-5e18bb8c-3e89-42a5-ae26-e6ecb9c6b60a req-92ae1050-a1dd-4236-8367-2f2bee6a69a5 service nova] Creating event network-changed:1e3edbbc-c6e8-46ad-99c0-ad3fc7356693 for instance 46acb22e-5b82-4d53-adae-81e616c05c32 on hv-cinder-85199 Aug 06 20:37:53.098878 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-5e18bb8c-3e89-42a5-ae26-e6ecb9c6b60a req-92ae1050-a1dd-4236-8367-2f2bee6a69a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112767 Aug 06 20:37:53.099885 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 30/62] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:53.110763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:53.112659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:53.141505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.141505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.141505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.141505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.141918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.141918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.199562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.329826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:53.340188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0fc6cf08-3b44-43c3-89ea-0c4d7871240b tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.366619 Aug 06 20:37:53.340811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 33/63] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:52 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:53.352447 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:53.361167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1b0ec37a-dbdc-4f1f-a24c-b3343cb6d92c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.259906 Aug 06 20:37:53.361745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:53 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:53.534835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-c867f02e-93b0-4ecd-84c7-cce1ab4e3cb7 req-083d028f-fee3-442e-84c2-09e9f77e1032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255f05a-c9a7-4116-8c52-3cc2273ccae5", "name": "network-vif-plugged", "status": "completed", "tag": "d8634471-c27b-4ee6-bf62-7f94cd7dbbdf"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:37:53.544860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-c867f02e-93b0-4ecd-84c7-cce1ab4e3cb7 req-083d028f-fee3-442e-84c2-09e9f77e1032 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.545339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-c867f02e-93b0-4ecd-84c7-cce1ab4e3cb7 req-083d028f-fee3-442e-84c2-09e9f77e1032 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.545764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-c867f02e-93b0-4ecd-84c7-cce1ab4e3cb7 req-083d028f-fee3-442e-84c2-09e9f77e1032 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.556670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-c867f02e-93b0-4ecd-84c7-cce1ab4e3cb7 req-083d028f-fee3-442e-84c2-09e9f77e1032 service nova] Creating event network-vif-plugged:d8634471-c27b-4ee6-bf62-7f94cd7dbbdf for instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 on hv-cinder-85199 Aug 06 20:37:53.561858 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-c867f02e-93b0-4ecd-84c7-cce1ab4e3cb7 req-083d028f-fee3-442e-84c2-09e9f77e1032 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219755 Aug 06 20:37:53.562453 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 34/65] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:37:53.989953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:53.990654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:53.996819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:53.997019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.997512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:53.997839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.998274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:53.999025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:53.999435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:53.999862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.004177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:54.004653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:54.005216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.005913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:54.006362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:54.006942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.194833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:54.202177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2bd68a58-3a57-4fc9-9dc8-635fd30ab500 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.216092 Aug 06 20:37:54.202747 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 32/66] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:53 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:54.216474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:54.224578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1d19d8d9-46d0-45f7-bc37-048c895c674a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.232506 Aug 06 20:37:54.225258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 35/67] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:53 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:54.361903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:54.362515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:54.368622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:54.369105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:54.369544 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.370232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:54.370689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:54.371112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.381291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:54.381907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:54.387754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:54.388234 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:54.388679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.389349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:54.389799 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:54.390217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:54.570026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:54.573284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:54.577878 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-917cce2b-ab88-41eb-951a-ec52e1dd253a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.220339 Aug 06 20:37:54.582340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 33/68] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:54 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:54.582474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3ac8cc1a-e6f8-4aed-8c86-39594afb8c9f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.203991 Aug 06 20:37:54.582474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 36/69] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:54 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:55.222808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:55.223451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:55.225274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:55.230384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.230868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.231321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.232015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.232463 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.232881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.245467 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:55.246221 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:55.252201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.252683 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.253144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.253808 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.254260 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.254679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.429374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:55.433305 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:55.437030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-cec22cff-3961-4cc9-9022-195b9f43c79c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.219143 Aug 06 20:37:55.437685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 34/70] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:55 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:55.440978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0dfdef3d-7da9-4ff6-b693-225dd3c2ea9c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.199310 Aug 06 20:37:55.441539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 37/71] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:55 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:55.598538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:55.599158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:55.604249 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:55.604869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:55.605233 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.605722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.606159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.606851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.607333 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.607757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.611056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.612073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.612511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.613206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:55.613672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:55.614102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:55.800381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:55.803532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:55.807788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f80074cb-9d6c-4c4b-8f5c-6662ea10a7c8 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.213604 Aug 06 20:37:55.808446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 35/72] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:55 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:55.810885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d2444795-6e43-4d17-9ca2-55279a8d7011 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.210318 Aug 06 20:37:55.811453 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 38/73] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:55 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:56.457762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:56.458377 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:56.461025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:56.462094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:56.464289 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.464773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.465207 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.465887 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.466340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.466769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.468024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.468506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.468940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.469629 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.470083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.470507 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.919443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:56.929637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b2500400-13f1-4cf6-9caa-2eee15424a20 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.476655 Aug 06 20:37:56.934519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:56.946200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 36/74] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:56 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:56.948579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bfcd61df-6cb8-49d6-b1c7-892a56666cdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.490863 Aug 06 20:37:56.950306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 39/75] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:56 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:56.956433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:56.957751 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:56.961584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:56.962343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:56.969258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.970058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.971434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.972493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.973251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.973498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.974004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.974344 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.974448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:56.975131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:56.975621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:56.976050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:57.421910 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:57.430362 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6523da4a-ceda-46b6-820a-2446ffcdd253 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.482949 Aug 06 20:37:57.431195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 37/76] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:56 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:57.434769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:57.443385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c23a61c5-1fa1-4a95-a421-f12612c55a86 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.491754 Aug 06 20:37:57.443958 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 40/77] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:56 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:57.959810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:57.960538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:57.966902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:57.967673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:57.968247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:57.969254 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:57.970028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:57.970628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:57.976598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:57.976598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:57.982481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:57.982868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:57.983393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:57.984090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:57.984543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:57.984963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:58.172280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:58.179401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:58.181109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ec8e371a-7a9d-4fc5-a861-18fb88d38fa0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.232192 Aug 06 20:37:58.181773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 38/78] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:57 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:58.186731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-631595b6-2120-4249-98c3-38dc75d85695 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.216304 Aug 06 20:37:58.187301 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 41/79] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:57 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:58.450570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:58.451398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:58.458339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:58.458771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:58.459209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:58.459932 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:58.460813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:58.461325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:58.466579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:58.467476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:58.475467 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:58.476134 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:58.476729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:58.477430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:58.478090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:58.478634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:58.677745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:58.681732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:58.685410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-24f2163b-8e94-4c0a-b003-1e4d25b9b182 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.238608 Aug 06 20:37:58.685971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 39/80] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:58 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:58.689308 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bde2058d-7997-4a3d-b942-f4727f2c6ec2 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.227598 Aug 06 20:37:58.689866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 42/81] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:58 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:59.202167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:59.202772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:59.207987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:59.208600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:59.209460 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.209924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.210352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.211035 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.211513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.211930 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.214452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.214935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.215418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.216114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.216567 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.216993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.410950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:59.418573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5844ccdb-0c91-4661-81c1-6a1c1b5cd2b3 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.220209 Aug 06 20:37:59.418990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:59.419143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 40/82] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:59 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:59.427375 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bdca08a3-ca03-44ce-bb0b-188a329b7977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.223881 Aug 06 20:37:59.427974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 43/83] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:59 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:37:59.706803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:59.707451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:59.710124 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:37:59.710739 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:37:59.713466 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.713962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.714397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.715095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.715591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.716019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.716502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.716978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.717405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.718086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:37:59.718535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:37:59.718953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:37:59.904482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:59.908486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:37:59.912014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5834f1d4-9c34-4c54-89da-2edf19c95e5d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.209804 Aug 06 20:37:59.912529 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 41/84] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:59 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:37:59.916051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a640fb46-5f5c-4f53-91d8-29f5aa4069e9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.209791 Aug 06 20:37:59.916613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 44/85] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:37:59 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:00.439584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:00.440119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:00.446279 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.446794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.447229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.447348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:00.447959 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.448083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:00.448417 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.448842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.453797 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.454287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.455513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.456206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.456663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.457091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.645103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:00.647959 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:00.652597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e2ba27a3-d206-485e-afde-6a6ceacaf3b0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.209110 Aug 06 20:38:00.653170 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 45/86] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:00 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:00.655158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c02822f6-de7c-4446-88d6-1e6cb6e8775e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.219505 Aug 06 20:38:00.655736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 42/87] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:00 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:00.932805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:00.933421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:00.936451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:00.937057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:00.939444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.939941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.940384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.941082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.941541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.941970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.942994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.943528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.944248 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:00.944936 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:00.945384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:00.945802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:01.130580 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:01.134397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:01.138051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a2473c6e-4988-4db3-ac30-b8928fa7ca21 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.209084 Aug 06 20:38:01.138656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 46/88] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:00 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:01.141633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3719c647-6c96-45e2-a4f3-2bf2fe5ef636 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.208981 Aug 06 20:38:01.142687 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 43/89] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:00 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:01.671972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:01.672586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:01.675314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:01.675957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:01.679222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:01.679732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:01.680166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:01.680861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:01.681319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:01.681742 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:01.681857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:01.682210 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:01.682638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:01.683345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:01.683798 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:01.684219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:01.870929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:01.878057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:01.879314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-545ec7a9-b19b-4c38-9c27-f02f2fe3085b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.211092 Aug 06 20:38:01.879987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 47/90] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:01 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:01.885577 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1424f826-b89f-4904-ac2e-18e377cb6207 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.214658 Aug 06 20:38:01.886123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 44/91] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:01 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:02.159841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:02.160371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:02.161601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:02.162239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:02.166410 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.166905 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.167352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.168042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.168317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.168506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.168928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.169034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.169365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.170082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.170535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.171067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.554555 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:02.558163 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:02.562234 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-098cd1c5-e03e-4cb4-b861-e60ad3066bde tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.406347 Aug 06 20:38:02.562813 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 48/92] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:02 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:02.565778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-033fda42-00ed-499c-91ab-a89fe5b9412b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.407895 Aug 06 20:38:02.566347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 45/93] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:02 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:02.893093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-10cc43f4-278c-4cb2-b2ad-187133779064 req-c7fcb86a-70e6-49b0-9f15-c683c6b5b5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d", "name": "network-vif-plugged", "status": "completed", "tag": "6fce6b6f-cd73-4f5c-9c57-051221c987e2"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:02.900686 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:02.902061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:02.903289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-10cc43f4-278c-4cb2-b2ad-187133779064 req-c7fcb86a-70e6-49b0-9f15-c683c6b5b5eb service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.903776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-10cc43f4-278c-4cb2-b2ad-187133779064 req-c7fcb86a-70e6-49b0-9f15-c683c6b5b5eb service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.904198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-10cc43f4-278c-4cb2-b2ad-187133779064 req-c7fcb86a-70e6-49b0-9f15-c683c6b5b5eb service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.910424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.910953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.914355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.915162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.915743 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.916246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.916528 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-10cc43f4-278c-4cb2-b2ad-187133779064 req-c7fcb86a-70e6-49b0-9f15-c683c6b5b5eb service nova] Creating event network-vif-plugged:6fce6b6f-cd73-4f5c-9c57-051221c987e2 for instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d on hv-cinder-85199 Aug 06 20:38:02.920843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:02.921470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-10cc43f4-278c-4cb2-b2ad-187133779064 req-c7fcb86a-70e6-49b0-9f15-c683c6b5b5eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Aug 06 20:38:02.922323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 49/94] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:02.927640 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:02.928405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:02.935043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.935551 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.935985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:02.936753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:02.937163 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:02.937520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:03.128979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:03.132140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:03.136489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ac90fb5e-5b29-4acf-a18a-9c97a6973487 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.240770 Aug 06 20:38:03.137151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 46/95] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:02 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:03.141606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c40d0655-35f5-4268-baaf-cc6edfaa4346 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.218373 Aug 06 20:38:03.142740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 50/96] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:02 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:03.583014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:03.583986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:03.586678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:03.587323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:03.590486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:03.591015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:03.591486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:03.592188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:03.592644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:03.593071 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:03.593191 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:03.593692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:03.594110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:03.594796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:03.595866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:03.596297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:03.614439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.800258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:03.800809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:03.809144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a71e7517-13c4-4670-9b83-76de67e2984d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.226269 Aug 06 20:38:03.810589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-444f414c-3cae-4a0c-b7c5-914d19ef27a7 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.232457 Aug 06 20:38:03.811300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 51/97] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:03 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:03.815693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 47/98] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:03 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:04.157339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:04.158126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:04.163507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:04.164241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.164813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:04.165192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.165868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.166956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.167653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.168276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.174391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.174891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.175352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.176371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.176962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.177421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.418942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:04.434599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-43d9a6ac-9300-494d-9803-0ff92b618f0e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.280954 Aug 06 20:38:04.444469 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:04.447851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 52/99] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:04 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:04.453313 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-66c3b935-9dcf-4912-bc1a-29666961de67 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.295282 Aug 06 20:38:04.453874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 48/100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:04 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:04.831762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:04.832501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:04.832619 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:04.833298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:04.838768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.839273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.839703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.840085 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.840397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.840772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.840879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.841246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.841467 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:04.842277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:04.842836 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:04.843395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:05.056295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:05.061238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:05.076755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ed8a4111-846b-4d80-82e8-2fc519a0ec91 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.248953 Aug 06 20:38:05.087761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a91d2ba7-4fd6-4029-a774-73bf0ef08d19 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.252527 Aug 06 20:38:05.087761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 53/101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:04 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:05.087937 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 49/102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:04 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:05.454978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:05.459314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:05.462639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:05.463127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:05.463631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:05.464330 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:05.464789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:05.465216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:05.475294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:05.475917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:05.481938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:05.482422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:05.482857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:05.483576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:05.484036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:05.484465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:05.684091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:05.687970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:05.696239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-400cb67c-9125-4620-9366-70caf60cef97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.224712 Aug 06 20:38:05.696816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 50/103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:05 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:05.697851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9c54c2f6-fc11-4e0b-b296-cec06c40cd24 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.247148 Aug 06 20:38:05.698481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 54/104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:05 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:06.098970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:06.099727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:06.102007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:06.102650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:06.107087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.108070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.108070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.108772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.108961 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.109599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.109717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.111029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.111296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.111388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.111869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.112614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.301893 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:06.308725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:06.309991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f5427cc6-ed6a-4674-b3ca-2ebae1ff6c2c tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.215976 Aug 06 20:38:06.310636 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 51/105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:06 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:06.320127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-294915b8-3c85-4baf-ac5a-d3fb6f9bd6a6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.222243 Aug 06 20:38:06.320690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 55/106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:06 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:06.719953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:06.722261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:06.722888 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:06.723613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:06.730473 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.731471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.732136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.733599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.734319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.734831 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.736565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.737478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.737934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.738662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:06.739340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:06.740064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:06.929218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:06.936794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-621a19ae-86e8-4c88-8a67-afa3d2f8f578 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.220830 Aug 06 20:38:06.948436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 56/107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:06 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:06.955088 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:06.964155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8a987549-cce7-4b9d-aad3-7d5e18d4762b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.250914 Aug 06 20:38:06.964755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 52/108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:06 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:07.329849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:07.330801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:07.336912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.338825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.338825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.338825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.339051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.339361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.344073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:07.344907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:07.350813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.351338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.351777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.352504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.352986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.353408 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.555503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:07.565773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:07.567073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3d9fa96b-1247-4702-962a-332cc3583809 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.240778 Aug 06 20:38:07.567750 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 57/109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:07 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:07.592073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1c7985aa-ba79-43fc-a098-95aa809d77da tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.251693 Aug 06 20:38:07.592666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 53/110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:07 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:07.959359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:07.959964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:07.965941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.966419 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.966851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.967587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.968039 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.968458 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.984590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:07.985203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:07.991657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.992144 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.992584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:07.993273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:07.993728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:07.994152 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:08.158125 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:08.165634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-93028917-1bf5-4b21-9247-074cf78fbbc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.210331 Aug 06 20:38:08.166214 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 58/111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:07 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:08.168925 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:08.177002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ac279557-de59-47e5-ba4e-87a80e8ede92 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.196256 Aug 06 20:38:08.177633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 54/112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:07 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:08.587704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:08.588304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:08.594189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:08.594668 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:08.595094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:08.595801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:08.596251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:08.596679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:08.613331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:08.613947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:08.619784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:08.620272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:08.620709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:08.621404 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:08.621863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:08.622287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:08.775132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:08.782515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f430979f-3957-4eb0-bcca-4aca0bedb9f0 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.198654 Aug 06 20:38:08.783146 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 59/113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:08 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:08.795565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:08.803419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ae6dad0b-f7d5-4864-b19a-49312c1a817b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.194457 Aug 06 20:38:08.803980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 55/114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:08 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:09.185807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:09.186550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:09.192576 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.193060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.193542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.194202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.194654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.195076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.197503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:09.197984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:09.205490 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.205986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.206420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.207113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.207593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.208013 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.398268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:09.402195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:09.405841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7287ea0f-4012-467f-a11d-1a6027b58309 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.223905 Aug 06 20:38:09.406419 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 60/115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:09 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:09.409624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6cf30b88-01a0-48bc-894a-308e4046676b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.216678 Aug 06 20:38:09.410174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 56/116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:09 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:09.801700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:09.802319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:09.808190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.808682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.809119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.809809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.810283 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.810697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.824078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:09.824622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:09.831255 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.831745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.832169 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:09.832843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:09.833291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:09.833705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:10.008374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:10.011663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:10.015889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-51993904-1f2a-4bf2-8fae-36e22183ec80 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.217953 Aug 06 20:38:10.016470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 61/117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:09 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:10.019637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6d7beb7d-986d-4fab-afd2-691e5c380e43 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.199358 Aug 06 20:38:10.020188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 57/118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:09 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:10.426167 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:10.426843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:10.430642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:10.431329 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:10.434459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:10.434950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:10.435416 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:10.436117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:10.436574 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:10.436997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:10.437286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:10.437771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:10.438215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:10.439547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:10.439999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:10.440420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:10.631103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:10.635072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:10.638674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-812861a8-5772-40b1-be64-55797a091b8f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.216900 Aug 06 20:38:10.639271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 62/119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:10 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:10.642654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b8c4f11c-6a2e-4b2e-a1a9-d40d19106277 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.215917 Aug 06 20:38:10.643206 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 58/120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:10 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:11.037491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:11.038104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:11.039440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:11.040052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:11.044078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.044568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.045074 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.045699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.046019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.046165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.046507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.046622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.046939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.047660 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.048117 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.048543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.242508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:11.245715 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:11.249972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6ff03a80-314d-494c-a54f-8ff545c4ae21 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.214290 Aug 06 20:38:11.250545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 59/121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:11 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:11.253171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d99e1c0d-3ed8-4e2f-852e-02a5f77e0069 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.219532 Aug 06 20:38:11.253894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 63/122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:11 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:11.659336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:11.659945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:11.661762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:11.662433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:11.663171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:11.667378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.667869 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.668298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.668985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.669097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.669438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.669535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.669853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.669945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.670601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:11.671061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:11.671517 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:11.866118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:11.871088 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:11.874048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-758e57ce-b52d-4df2-b41c-8d37853af251 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.219052 Aug 06 20:38:11.874626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 60/123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:11 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:11.878899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-34f33aa3-01e6-4ec8-bfc8-44fed3cf595d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.220344 Aug 06 20:38:11.879493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 64/124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:11 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:12.269677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:12.270284 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:12.273257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:12.273474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:12.276156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.276709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.277138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.277825 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.278276 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.278691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.279359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.279842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.280276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.280966 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.281418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.281983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.473402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:12.477079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:12.480974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-eb19f5a0-a4d5-4a64-94f1-ed40713a5e2b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.215040 Aug 06 20:38:12.481763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 61/125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:12 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:12.484948 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b919153c-356e-4e25-a951-803af72a41a3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.215788 Aug 06 20:38:12.485669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 65/126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:12 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:12.894401 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:12.895011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:12.898763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:12.899393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:12.901073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.901559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.901989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.902679 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.903180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.903565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.905559 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.906036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.906465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:12.907150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:12.907631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:12.908050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:13.092126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:13.094387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:13.101643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-421d9e49-61f2-4d26-9a76-5387c56ba607 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.211612 Aug 06 20:38:13.102231 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 62/127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:12 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:13.103148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:13.111534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f113cbcc-cd6b-4a12-9e98-435dfa3b746d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.216598 Aug 06 20:38:13.115610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 66/128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:12 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:13.501743 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:13.502268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:13.504203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:13.504861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:13.510016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:13.510692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:13.510901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:13.511418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:13.511560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:13.511858 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:13.512370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:13.512550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:13.512981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:13.513108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:13.513399 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:13.513615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:13.715153 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:13.723095 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bc19f330-4c7e-41bc-a35c-28f35884680a tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.222660 Aug 06 20:38:13.723630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:13.723767 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 67/129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:13 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:13.731950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3ec359ce-db1d-45a0-a443-931b78d36f13 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.234314 Aug 06 20:38:13.732633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 63/130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:13 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:14.123064 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:14.123695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:14.129553 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.130031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.130460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.131140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.131628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.132039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:14.132485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.132681 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:14.136023 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:14.138879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.139400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.139836 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.140522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.140974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.141394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.326912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:14.335057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6377cac4-e6fe-4fb7-ab50-70b7074599e1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.206723 Aug 06 20:38:14.335902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 64/131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:14 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:14.338757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:14.348004 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a69e5ffd-dea1-4704-aec4-9979910b73a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.228755 Aug 06 20:38:14.348563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 68/132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:14 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:14.442464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-4e08bd93-4624-467d-837f-23ccf28fa5fa req-8deec7b6-95a5-4275-929b-d113e75db4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72752a0b-3b0b-428e-b578-4958b8a51a1b", "name": "network-vif-plugged", "status": "completed", "tag": "3533274d-9341-439a-8e8f-6ff119c5b8e3"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:14.458332 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-4e08bd93-4624-467d-837f-23ccf28fa5fa req-8deec7b6-95a5-4275-929b-d113e75db4c6 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.459149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-4e08bd93-4624-467d-837f-23ccf28fa5fa req-8deec7b6-95a5-4275-929b-d113e75db4c6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.459713 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-4e08bd93-4624-467d-837f-23ccf28fa5fa req-8deec7b6-95a5-4275-929b-d113e75db4c6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.472882 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-4e08bd93-4624-467d-837f-23ccf28fa5fa req-8deec7b6-95a5-4275-929b-d113e75db4c6 service nova] Creating event network-vif-plugged:3533274d-9341-439a-8e8f-6ff119c5b8e3 for instance 72752a0b-3b0b-428e-b578-4958b8a51a1b on hv-cinder-85199 Aug 06 20:38:14.479518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-4e08bd93-4624-467d-837f-23ccf28fa5fa req-8deec7b6-95a5-4275-929b-d113e75db4c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042923 Aug 06 20:38:14.480488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 65/133] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:14.743178 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:14.743853 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:14.749804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.750286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.750716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.752516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.753198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.753461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:14.753925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.754169 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:14.760846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.761337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.761783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.762476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:14.762934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:14.763422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:14.950062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:14.958140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7ae906c0-7f15-4d77-b0ae-02f92b55bc9d tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.218851 Aug 06 20:38:14.959103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 69/134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:14 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:14.961968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:14.973838 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-31f31839-ebc7-404a-9ad6-fe54a0f94fb5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.225021 Aug 06 20:38:14.974337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 66/135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:14 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:15.356446 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:15.357168 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:15.369273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:15.370008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:15.375914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:15.379435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:15.379934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:15.380373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:15.381070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:15.381773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:15.382362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:15.383359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:15.383976 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:15.384556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:15.385180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:15.389850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:15.627806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:15.637580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-88a3e19f-4290-4330-a8fe-ddd57916e1d2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.272043 Aug 06 20:38:15.639386 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 67/136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:15 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:15.668641 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:15.677947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-013dc945-6961-4b66-b902-07dfc905e3da tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.325191 Aug 06 20:38:15.678534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 70/137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:15 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:15.980148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:15.980829 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:15.988290 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:15.989003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:15.989435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:15.990367 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:15.990926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:15.991482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:15.996295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:15.997240 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:15.999223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=98 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.005980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:16.006776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:16.007498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:16.008512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:16.009082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:16.009621 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:16.276195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:16.279559 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:16.284899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-98c9168c-f79f-473f-b648-ae6fbb7a9681 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.308685 Aug 06 20:38:16.287896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e7476713-d637-4228-95a3-2a1ccf8d7108 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.296923 Aug 06 20:38:16.288633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 71/138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:15 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:16.298947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 68/139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:15 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:16.666959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:16.669669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:16.675910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:16.676752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:16.677347 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:16.678309 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:16.678632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:16.679331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:16.698108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:16.698653 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:16.707275 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:16.707763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:16.708192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:16.708874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:16.711509 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:16.714648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:16.906084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:16.915702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5f98a41d-8243-4ead-9938-4a0824a3d5f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.256999 Aug 06 20:38:16.920062 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:16.928570 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 72/140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:16 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:16.931035 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1d056c3a-ed9c-45a9-b603-747266b48783 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.236757 Aug 06 20:38:16.931824 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 69/141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:16 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:17.305936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:17.306549 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:17.309105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:17.310311 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:17.313372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.314797 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.315863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.317028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.317685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.318209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.319191 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.319458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.319862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.321944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.322565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.325020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.543220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:17.554920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:17.558567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ea12970d-ae57-4ddf-8980-6cc92c0273d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.246624 Aug 06 20:38:17.563839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 70/142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:17 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:17.564421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4a3f2d63-89b6-4c7c-b9c4-8aa87c53385e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.261483 Aug 06 20:38:17.564985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 73/143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:17 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:17.935146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:17.935792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:17.942157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.942562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.943006 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.943734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.944197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.944657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.954686 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:17.956214 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:17.971784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.972588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.973134 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:17.974277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:17.974906 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:17.975457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:18.159757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:18.168111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-12942c0f-aa83-40a8-9473-71824c6e1d2e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.235831 Aug 06 20:38:18.171382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 71/144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:17 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:18.183569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:18.193740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c7e24940-132d-4682-9875-9221759d9187 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.245651 Aug 06 20:38:18.194310 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 74/145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:17 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:18.579038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:18.585573 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:18.586465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:18.586797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:18.598540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:18.599705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:18.600199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:18.600736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:18.601245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:18.601816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:18.602607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:18.603722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:18.604343 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:18.604912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:18.605529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:18.606146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:18.845901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:18.849990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:18.856092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6bf19b44-efda-4e35-9f33-8bc17078a3c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.274526 Aug 06 20:38:18.857707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-259df14c-0b48-4200-b226-ee5a9d1d5068 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.282438 Aug 06 20:38:18.858272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 72/146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:18 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:18.880114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 75/147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:18 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:19.188051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:19.189330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:19.196247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.197139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.197459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.198219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.198620 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.199029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.224557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:19.226059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:19.239521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.240242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.241429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.242752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.243449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.244080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.419709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:19.429961 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-42d771a0-cff5-4449-ab4b-5c37327572f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.245305 Aug 06 20:38:19.439856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:19 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:19.444286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:19.452828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-28d1fbe4-9182-4231-8b92-e38fb6e333ec tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.238523 Aug 06 20:38:19.453499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 76/149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:19 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:19.878530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:19.879375 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:19.891205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:19.891205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:19.895785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.896445 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.897911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.899277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.899984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.900888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.902306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.902822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.903854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:19.907179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:19.908593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:19.911750 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:20.397101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:20.400999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:20.406898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0d5f5ba1-1886-4956-ad9a-aa1534b2a7ab tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.521940 Aug 06 20:38:20.408584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 77/150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:19 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:20.409896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-643e6cba-520e-440d-92d5-2b5085fad468 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.536173 Aug 06 20:38:20.410461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 74/151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:19 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:20.452878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:20.453613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:20.460558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:20.461176 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:20.461724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:20.462439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:20.463101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:20.463730 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:20.476007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:20.476839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:20.484343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:20.484937 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:20.486155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:20.487118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:20.487810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:20.488387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:20.709724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:20.719065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b9a0bbd8-d14d-44a8-95dd-a49cace1991b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.270106 Aug 06 20:38:20.727192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 78/152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:20 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:20.744683 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:20.757980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0b593907-b14f-4263-aa1d-28eb0ddb89cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.286639 Aug 06 20:38:20.760586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 75/153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:20 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:21.442089 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:21.443483 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:21.444098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:21.446376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:21.453223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.456302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.457087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.457209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.457659 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.458092 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.458687 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.459908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.460417 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.460648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.460895 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.461324 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.703569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:21.710451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:21.714160 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4413f586-2a29-4ccc-bb10-b102f665d19a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.278265 Aug 06 20:38:21.715392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 79/154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:21 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:21.718628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3fcb1372-1924-4545-b263-d9a00d1a14f6 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.284674 Aug 06 20:38:21.720074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 76/155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:21 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:21.748098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:21.748725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:21.756405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.757078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.757666 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.758521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.759749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.760345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.784691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:21.786109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:21.797698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.798806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.799506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.800762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:21.801479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:21.802128 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:21.972425 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:21.983076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9e916f22-8fe9-4b99-835b-4d97a47be46a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.237153 Aug 06 20:38:21.983076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 80/156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:21 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:22.006786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:22.016209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3712c296-18b7-49f4-b469-a6ce3f946446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.239432 Aug 06 20:38:22.018376 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 77/157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:21 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:22.743821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-23503037-b439-47ed-9969-d0c28d2e407c req-70a2f1c8-851e-47d9-8182-bd9b1d96f436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46acb22e-5b82-4d53-adae-81e616c05c32", "name": "network-vif-plugged", "status": "completed", "tag": "1e3edbbc-c6e8-46ad-99c0-ad3fc7356693"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:22.746157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:22.751805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:22.763146 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:22.767520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:22.776625 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:22.777594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:22.779846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-23503037-b439-47ed-9969-d0c28d2e407c req-70a2f1c8-851e-47d9-8182-bd9b1d96f436 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:22.780326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-23503037-b439-47ed-9969-d0c28d2e407c req-70a2f1c8-851e-47d9-8182-bd9b1d96f436 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:22.780754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-23503037-b439-47ed-9969-d0c28d2e407c req-70a2f1c8-851e-47d9-8182-bd9b1d96f436 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:22.783162 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:22.783737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:22.805662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-23503037-b439-47ed-9969-d0c28d2e407c req-70a2f1c8-851e-47d9-8182-bd9b1d96f436 service nova] Creating event network-vif-plugged:1e3edbbc-c6e8-46ad-99c0-ad3fc7356693 for instance 46acb22e-5b82-4d53-adae-81e616c05c32 on hv-cinder-85199 Aug 06 20:38:22.816919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-23503037-b439-47ed-9969-d0c28d2e407c req-70a2f1c8-851e-47d9-8182-bd9b1d96f436 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079509 Aug 06 20:38:22.817531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 78/158] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:22.826481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:22.827201 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:22.833606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:22.834293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:22.834905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:22.839142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:22.840141 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:22.840737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:23.083760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:23.093257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fa0e9e96-b8d8-4d3c-8595-5609a1d3208e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.360929 Aug 06 20:38:23.094027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 81/159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:22 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:23.098903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:23.099900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:23.105885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:23.106448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:23.106771 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:23.107493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:23.108290 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:23.108867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:23.129974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:23.137389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2b11204a-4043-467a-98aa-4f510c179027 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.318725 Aug 06 20:38:23.137974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 79/160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:22 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:23.143216 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:23.144280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:23.151188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:23.151707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:23.152147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:23.152842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:23.153297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:23.153723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:23.299324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:23.307066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-754d614d-b897-4f20-aa41-e35781479bdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.211588 Aug 06 20:38:23.307761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 82/161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:23 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:23.326941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:23.329321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:23.336402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-335d5d5f-d6df-405c-847f-3b7b0b5ef6c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.197456 Aug 06 20:38:23.336972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 80/162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:23 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:24.114627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:24.115230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:24.121042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.121518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.121943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.122618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.123065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.123511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.158161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:24.158800 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:24.164916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.165412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.165848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.166545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.167082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.167479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.297784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:24.306034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1e8daf2d-c910-4c6a-80e9-0949fc74a5c0 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.196201 Aug 06 20:38:24.306938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 83/163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:24 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:24.326178 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:24.328590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:24.329798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:24.334505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-14a391af-5070-4c97-b8d4-b6d41645cd97 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.180817 Aug 06 20:38:24.335067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 81/164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:24 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:24.335808 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.336296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.336727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.337409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.337859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.338277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.357026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:24.357709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:24.365500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.366053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.366487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.367391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:24.367927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:24.368387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:24.537193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:24.540350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:24.540634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:24.545607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e3e97f5d-4585-4f82-b768-a7292d2fc55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.220655 Aug 06 20:38:24.546173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 84/165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:24 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:24.547983 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6d6e4967-3b5d-4b0d-9080-04872cd4ee84 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.194664 Aug 06 20:38:24.548547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 82/166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:24 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:25.326711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:25.327355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:25.333571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.334052 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.334483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.335166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.335656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.336081 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.354104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:25.354735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:25.362954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.363475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.363903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.364586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.365036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.365453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.526535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:25.533983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c714f491-f2ab-4bda-b951-b1ea643c4b26 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.211387 Aug 06 20:38:25.534564 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 85/167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:25 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:25.537659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:25.545145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-703f126f-d6e3-42b7-9c80-1456dc9bb980 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.194743 Aug 06 20:38:25.545711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 83/168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:25 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:25.566205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:25.566848 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:25.567925 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:25.568522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:25.573018 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.573505 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.573943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.574131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.574606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.574696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.575033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.575123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.575512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.575726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:25.576180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:25.576593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:25.767444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:25.770995 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:25.776907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1b5a8e90-d684-4a0e-b1b0-b010f7022364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.214950 Aug 06 20:38:25.777663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 86/169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:25 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:25.778498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e1c388d0-deb6-40cc-8bb5-226b363da55d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.214123 Aug 06 20:38:25.779054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 84/170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:25 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:26.553787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:26.554389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:26.560334 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.560815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.561241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.561917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.562397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.562818 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.564843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:26.565453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:26.571511 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.571993 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.572422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.573105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.573556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.573978 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.760368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:26.766903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:26.768054 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-31c1ef99-745a-482a-bad0-9d0aa56fd5f1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.218058 Aug 06 20:38:26.768620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 87/171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:26 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:26.774570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-730bfc7b-7c6d-447c-bb5c-55ff48034c4e tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.214105 Aug 06 20:38:26.775121 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 85/172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:26 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:26.798157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:26.798763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:26.799008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:26.799631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:26.804851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.805284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.805471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.805723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.805904 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.806356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.806460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.806869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.807036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:26.807305 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:26.807490 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:26.807907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:27.002254 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:27.004999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:27.009680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-49aa9add-b575-41fe-b602-99724bb713da tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.215801 Aug 06 20:38:27.010253 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 88/173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:26 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:27.012424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2b5a9d81-9963-4425-9d27-dc8101e28148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.217445 Aug 06 20:38:27.012980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 86/174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:26 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:27.793962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:27.794617 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:27.797963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:27.798577 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:27.800848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:27.801371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:27.801797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:27.802673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:27.803124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:27.803580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:27.804976 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:27.805458 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:27.805895 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:27.806592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:27.807040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:27.807490 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:27.998526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:28.005732 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:28.006890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-970911d1-d0e1-4839-b47d-8b05d8668553 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.221675 Aug 06 20:38:28.007512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 89/175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:27 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:28.013105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dc96208d-e1cb-4e47-bf45-1e035f5a46c4 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.223274 Aug 06 20:38:28.013656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 87/176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:27 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:28.029892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:28.030501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:28.032655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:28.033258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:28.036404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:28.036887 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:28.037318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:28.038007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:28.038461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:28.038883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:28.039029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:28.039569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:28.040007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:28.040690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:28.041150 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:28.041575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:28.231824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:28.238522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:28.241301 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7e5c7bf5-a1b7-4e8d-9b39-73649aa4d519 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.215328 Aug 06 20:38:28.242297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 90/177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:28 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:28.246266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e5a6b649-43dd-433d-b345-44a266ccd969 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.217237 Aug 06 20:38:28.247024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 88/178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:28 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:29.027292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:29.027904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:29.034189 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:29.034783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.034906 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:29.035447 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.035957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.036752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.037280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.037946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.041158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.041640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.042075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.042753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.043204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.043646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.379146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:29.386328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:29.391550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9515572f-6a1a-4786-8fb4-43d192624a62 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1315 microversion: 2.1 time: 0.361088 Aug 06 20:38:29.393403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 89/179] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:29 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:29.398015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-861f17c8-49c8-409d-b591-18cf2d3dfae9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.374474 Aug 06 20:38:29.398695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 91/180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:29 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:29.403424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:29.404418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:29.408891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:29.409530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:29.413178 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.413768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.414328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.415116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.415564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.415807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.415992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.416409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.416509 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.417101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:29.417560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:29.417979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:29.632058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:29.635950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:29.639663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-376cd361-9cb5-4ba3-9c29-34de1b8024cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.239677 Aug 06 20:38:29.640245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 92/181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:29 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:29.646041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ca24dc52-ef2c-40ec-86b1-fd1bce75b12b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.241320 Aug 06 20:38:29.647138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 90/182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:29 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:30.414689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:30.416556 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:30.431512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:30.432857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:30.440330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.441845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.442438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.444302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.444918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.445157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.445420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.445866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.446082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.448573 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.449047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.449484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.704802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:30.716911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-297f395c-2f96-4a4e-bcc3-f6e5ea962e50 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.300412 Aug 06 20:38:30.730243 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 91/183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:30 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:30.737614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:30.741437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:30.757079 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.759124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.760026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.763528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.764464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.765370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.783775 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:30.792099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0b19b56f-08d3-4a93-81f4-cab4351fe020 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1502 microversion: 2.1 time: 0.381862 Aug 06 20:38:30.793059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 93/184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:30 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:30.798222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:30.799041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:30.812594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.813526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.814577 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:30.815369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:30.815841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:30.816314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:31.016270 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:31.023572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-705e472b-b483-4313-b49c-62bef74db482 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.304282 Aug 06 20:38:31.024358 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 92/185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:30 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:31.029422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-5ad4db48-fd76-4bd5-8927-ffc570ff8a51 req-d6459464-0045-4726-bf02-1923879e7543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7e3d25-df60-4e49-9e80-4378cc82513f", "name": "network-vif-plugged", "status": "completed", "tag": "29dc41a1-2bf2-42c4-a80a-e612ddfd232f"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:31.039641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5ad4db48-fd76-4bd5-8927-ffc570ff8a51 req-d6459464-0045-4726-bf02-1923879e7543 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:31.040198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5ad4db48-fd76-4bd5-8927-ffc570ff8a51 req-d6459464-0045-4726-bf02-1923879e7543 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:31.040688 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5ad4db48-fd76-4bd5-8927-ffc570ff8a51 req-d6459464-0045-4726-bf02-1923879e7543 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:31.046921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:31.052665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-5ad4db48-fd76-4bd5-8927-ffc570ff8a51 req-d6459464-0045-4726-bf02-1923879e7543 service nova] Creating event network-vif-plugged:29dc41a1-2bf2-42c4-a80a-e612ddfd232f for instance 8d7e3d25-df60-4e49-9e80-4378cc82513f on hv-cinder-85199 Aug 06 20:38:31.057528 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1f66dc02-87ce-4b38-beaa-5458f0d9011c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.263208 Aug 06 20:38:31.057823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-5ad4db48-fd76-4bd5-8927-ffc570ff8a51 req-d6459464-0045-4726-bf02-1923879e7543 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031918 Aug 06 20:38:31.058421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 94/186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:30 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:31.058566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 93/187] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:31.738064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:31.739171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:31.745792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:31.746279 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:31.746722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:31.747448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:31.747912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:31.748338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:32.045369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:32.045990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:32.052757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:32.053245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:32.053680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:32.054396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:32.055046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:32.055503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:32.075261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:32.084514 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0cce9bd9-f990-4d25-9e30-4c7e153af150 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.350854 Aug 06 20:38:32.090992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 94/188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:31 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:32.090992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:32.090992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:32.097726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:32.098459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:32.099098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:32.099869 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:32.100334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:32.100769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:32.248275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:32.256241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-781a76bd-f4d6-4f92-9e59-df1cca75e5f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.214742 Aug 06 20:38:32.256883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 95/189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:32 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:32.277689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:32.285674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6ee3c290-cc1e-45ed-ba04-c83121fe6126 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.199288 Aug 06 20:38:32.286229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 95/190] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:32 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:33.106012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:33.106619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:33.114648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:33.115127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:33.115590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:33.116270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:33.116719 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:33.117135 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:33.245009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:33.253873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-19a7dc8c-37d3-4e41-b49b-cc0bdba50afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.151789 Aug 06 20:38:33.254444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 96/191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:33 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:33.276937 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:33.277545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:33.283949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:33.284428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:33.284859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:33.285539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:33.285994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:33.286413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:33.307774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:33.308383 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:33.314247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:33.314783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:33.315226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:33.315964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:33.316420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:33.316850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:33.476160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:33.483411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0833ada1-2f86-4438-bd99-054b28313347 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.210152 Aug 06 20:38:33.483972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 96/192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:33 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:33.497166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:33.505089 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-472b8f0d-3aff-4aca-bea0-b3ec68539740 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.201170 Aug 06 20:38:33.506376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 97/193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:33 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:34.274532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:34.275144 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:34.281045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:34.282301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:34.282606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:34.283327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:34.283788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:34.284214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:34.416874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:34.425133 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f1edd277-2b8e-4227-921c-72860c9522ec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.154306 Aug 06 20:38:34.425702 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 97/194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:34 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:34.504929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:34.505540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:34.511604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:34.512281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:34.512719 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:34.513410 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:34.514019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:34.514998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:34.527444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:34.528580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:34.535235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:34.535955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:34.536793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:34.537746 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:34.538274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:34.538803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:34.544508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:34.773081 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:34.775549 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:34.780563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ee9e09f8-f16b-4ea3-8f57-b3bf0d37c750 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.258925 Aug 06 20:38:34.781066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 98/195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:34 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:34.784216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f1e881e4-b80b-40dd-afb1-59482d66119f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.283779 Aug 06 20:38:34.784780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 98/196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:34 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:35.445506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:35.446106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:35.452012 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:35.452489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:35.452916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:35.453596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:35.454045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:35.454464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:35.584067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:35.591553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-eee83f93-5d49-4cc1-a620-5ae6a8673146 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.149814 Aug 06 20:38:35.592109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 99/197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:35 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:35.801466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:35.802153 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:35.804242 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:35.804850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:35.808328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:35.808882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:35.809403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:35.810158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:35.810670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:35.810783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:35.811172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:35.811291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:35.811647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:35.812341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:35.812825 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:35.813249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:36.013410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:36.017979 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:36.022016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-28aed1c4-962a-4892-8d09-d8c9173c94e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.221393 Aug 06 20:38:36.022752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 100/198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:35 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:36.030674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2e1adb06-7690-4928-a5b6-e76ef4b64cb1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.233074 Aug 06 20:38:36.031396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 99/199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:35 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:36.612763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:36.613371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:36.619220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:36.619730 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:36.620162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:36.620847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:36.621301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:36.621719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:36.750748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:36.758341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-894116a4-1254-489b-97ad-85a0ce4d4d8f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.150001 Aug 06 20:38:36.758902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 101/200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:36 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:37.042795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:37.043521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:37.050103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:37.050591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:37.055223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:37.055223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:37.055223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:37.055223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:37.055741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:37.055741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:37.059499 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:37.059984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:37.060418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:37.061106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:37.061612 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:37.062034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:37.247497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:37.250407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:37.255205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-dae85d03-dec9-445b-a851-02d153e67a0f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.216116 Aug 06 20:38:37.255827 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 100/201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:37 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:37.257819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6f75e080-11a6-4546-8533-9ac3beff1887 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.209173 Aug 06 20:38:37.258528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 102/202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:37 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:37.778834 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:37.779397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:37.785468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:37.786877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:37.787339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:37.788868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:37.789332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:37.790530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:37.808782 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:37.919945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:37.927708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6309e52d-8c0b-4f2b-99e4-b5bef1c1e8e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.152964 Aug 06 20:38:37.928266 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 101/203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:37 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:38.275952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:38.276563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:38.277476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:38.278087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:38.283230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:38.283746 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:38.284179 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:38.284324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:38.284801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:38.284903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:38.285236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:38.285334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:38.285756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:38.285939 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:38.286342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:38.286760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:38.477926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:38.481761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:38.486970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-75ee3f38-21e3-4cc5-8b23-d03ceb21d469 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.215046 Aug 06 20:38:38.487666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 103/204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:38 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:38.489716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-75831eb8-2d73-4fee-a252-2c1a46d593a9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.215899 Aug 06 20:38:38.490413 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 102/205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:38 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:38.948610 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:38.949222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:38.955982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:38.956485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:38.956916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:38.957602 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:38.958054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:38.958475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:39.087620 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:39.096086 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0d600a72-6d87-48a8-960f-510f848d3c07 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.151244 Aug 06 20:38:39.096670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 104/206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:38 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:39.507488 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:39.508099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:39.509016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:39.509624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:39.514362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:39.514850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:39.515302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:39.515759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:39.515990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:39.516231 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:39.516446 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:39.516659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:39.516867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:39.517331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:39.517780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:39.518192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:39.727131 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:39.730321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:39.734798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ab049604-bff6-46e9-87ad-653bd8644bd5 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.231142 Aug 06 20:38:39.735386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 103/207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:39 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:39.737806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9387a807-406e-409f-9cdc-80ca346e4561 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.232419 Aug 06 20:38:39.738368 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 105/208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:39 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:40.116622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:40.117242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:40.123079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:40.123600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:40.124028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:40.124712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:40.125751 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:40.126187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:40.255384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:40.262728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-45a96c3d-5612-4a89-8202-ce9729e09cca tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.150063 Aug 06 20:38:40.263308 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 104/209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:40 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:40.754790 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:40.755459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:40.757660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:40.758272 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:40.761463 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:40.761950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:40.762386 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:40.763074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:40.763559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:40.763984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:40.764531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:40.765011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:40.765440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:40.766149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:40.766598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:40.767092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:40.958109 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:40.960997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:40.965548 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-da90016c-9f08-4577-915e-7db6a88d9041 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.211571 Aug 06 20:38:40.966294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 105/210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:40 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:40.968406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d29c8597-2239-4430-817b-e30c7a70e996 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.217445 Aug 06 20:38:40.969544 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 106/211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:40 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:41.283566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:41.284164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:41.289937 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:41.290414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:41.290844 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:41.291551 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:41.292001 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:41.292418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:41.420619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:41.429832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-660146b9-a107-42e2-8de4-cedb857ceb01 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.149657 Aug 06 20:38:41.430813 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 106/212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:41 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:41.986055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:41.986660 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:41.988548 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=94 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:41.989118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:41.989760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:41.993750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:41.994234 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:41.994672 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:41.995394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:41.995851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:41.995970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:41.996274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:41.996450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:41.996880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:41.997563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:41.998012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:41.998433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:42.187058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:42.190468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:42.195794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d85fcd9e-2891-406e-be5a-d0f4aebcfb69 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.213612 Aug 06 20:38:42.196592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 107/213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:41 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:42.197948 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-29c03695-4f6e-4cb1-947c-8b2a88c76027 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.212702 Aug 06 20:38:42.210892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 107/214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:41 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:42.450749 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:42.451296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:42.457997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:42.458475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:42.458902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:42.459604 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:42.460054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:42.460471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:42.583667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:42.591136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-305d9d57-0f75-4238-99e6-8dfbb6003b2c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.144185 Aug 06 20:38:42.591728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 108/215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:42 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:43.217832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:43.218493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:43.218871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:43.219499 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:43.224468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:43.224940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:43.225191 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:43.225373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:43.225662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:43.226057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:43.226159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:43.226512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:43.226746 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:43.226936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:43.227208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:43.227637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:43.422311 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:43.429082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:43.429756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1aa25913-f682-40df-9535-7ff5c6507038 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.214565 Aug 06 20:38:43.430323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 109/216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:43 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:43.436508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8701559d-d9ef-42d6-b957-436e9ab27a55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.223279 Aug 06 20:38:43.437060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 108/217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:43 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:43.612393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:43.612998 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:43.619008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:43.619519 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:43.619947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:43.620619 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:43.621064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:43.621475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:43.746932 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:43.754762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-24f3e94e-af1e-4c73-8244-65898c9b4796 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.146366 Aug 06 20:38:43.755342 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 110/218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:43 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:44.449433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:44.450043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:44.456912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:44.457094 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:44.457517 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:44.457697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:44.457885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:44.458581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:44.459036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:44.459485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:44.463406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:44.463887 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:44.464316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:44.464999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:44.465446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:44.465864 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:44.650474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:44.654642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:44.657900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0e18e504-3b16-4598-bc0a-f7e7da040c5a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.212304 Aug 06 20:38:44.658479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 109/219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:44 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:44.662139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5dfe4c7b-e142-4bf2-b19e-d7873629bc13 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.209660 Aug 06 20:38:44.662786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 111/220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:44 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:44.775319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:44.775922 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:44.782437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:44.782913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:44.783367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:44.784043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:44.784496 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:44.784916 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:44.915152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:44.922443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0686372f-2205-480c-81fd-48bb4d422d16 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.150901 Aug 06 20:38:44.923024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 110/221] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:44 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:45.678938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:45.679526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:45.682155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:45.682761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:45.685512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:45.685993 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:45.686421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:45.687106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:45.688253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:45.688677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:45.689181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:45.690032 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:45.690152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:45.690778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:45.691233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:45.691685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:45.895554 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:45.897686 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:45.905021 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0a87b588-ee76-4650-9eb3-6d79f860a56b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.226617 Aug 06 20:38:45.905769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 111/222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:45 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:45.906481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e81887f7-46b6-4069-af5c-c27576697a01 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.231612 Aug 06 20:38:45.907099 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 112/223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:45 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:45.942150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:45.942692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:45.948448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:45.948923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:45.949352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:45.950034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:45.950481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:45.950898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:46.079277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:46.087593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-271d1684-27f7-45f2-80f8-933e88c1e964 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.149128 Aug 06 20:38:46.088159 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 112/224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:45 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:46.925620 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:46.926061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:46.926402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:46.926483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:46.929766 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=84 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:46.932613 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:46.933047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:46.933486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:46.934184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:46.934289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:46.934643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:46.934777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:46.935070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:46.935184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:46.936913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:46.936913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:46.936913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:47.128289 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:47.134715 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:47.135752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c6551ee8-7b02-45bf-aa3b-976e20d119a6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.213823 Aug 06 20:38:47.136348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 113/225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:46 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:47.141203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:47.141802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:47.143187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3cc52af2-7d1c-45c9-bf73-7df28aa84bdf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.221184 Aug 06 20:38:47.143921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 113/226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:46 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:47.147552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:47.148043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:47.148478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:47.149171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:47.149617 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:47.150039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:47.279564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:47.282340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:47.288737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2613608e-4f31-4215-a92b-2ba85e9f8934 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.151455 Aug 06 20:38:47.289297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 114/227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:47 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:48.157343 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:48.158027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:48.163063 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:48.163711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:48.164048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:48.164532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:48.165168 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:48.165863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:48.166311 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:48.166730 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:48.169585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:48.170060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:48.170491 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:48.171168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:48.171643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:48.172640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:48.363292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:48.364944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:48.371061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-09341ee4-6451-499e-9768-6dfbd16ab3de tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.218103 Aug 06 20:38:48.371690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 114/228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:48 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:48.372638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0210d7f2-1ec0-4144-8fa8-6d181a718d28 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.213435 Aug 06 20:38:48.373196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 115/229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:48 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:48.380581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:48.381186 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:48.386883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:48.387382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:48.387816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:48.388500 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:48.388952 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:48.389372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:48.519096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:48.526558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-39dc71ea-00ef-4cf7-afe5-53b1a0a8db70 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.149553 Aug 06 20:38:48.527115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 115/230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:48 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:49.392556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:49.393080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:49.393898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:49.393981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:49.399223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:49.399373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:49.399731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:49.399841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:49.400165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:49.400285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:49.400854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:49.400955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:49.401308 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:49.401409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:49.401728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:49.401819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:49.592656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:49.595583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:49.600322 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4c383ca4-9a0d-4358-badd-2e5ec035114c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.211626 Aug 06 20:38:49.602879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 116/231] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:49 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:49.605360 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:49.605970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:49.607997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e724be61-d333-4237-9c63-12e8223c1448 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.219059 Aug 06 20:38:49.608728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 116/232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:49 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:49.611763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:49.612243 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:49.612671 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:49.613667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:49.614115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:49.614531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:49.738646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:49.745895 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-94cf245f-f4d3-4f0e-8520-6f858986620a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.144053 Aug 06 20:38:49.746452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 117/233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:49 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:50.620656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:50.621265 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:50.628223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:50.628746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:50.628992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:50.629422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:50.629616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:50.629845 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:50.630300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:50.630722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:50.635564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:50.636040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:50.636521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:50.637198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:50.637647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:50.638062 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:50.822376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:50.828774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:50.830056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-310814aa-241f-4f72-a239-43daeb611ab4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.213230 Aug 06 20:38:50.830969 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 117/234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:50 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:50.835422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:50.836091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:50.836679 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bca5006a-cde1-4abd-b2a0-434b67d627ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.211998 Aug 06 20:38:50.837363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 118/235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:50 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:50.841781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:50.842340 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:50.842847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:50.843638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:50.844092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:50.844511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:50.848491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:50.969891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:50.977150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7b5fc804-9222-477d-a610-c5a426105acc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1368 microversion: 2.1 time: 0.145155 Aug 06 20:38:50.977716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 118/236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:50 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:51.850394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:51.850999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:51.856742 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:51.857173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:51.857382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:51.857485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:51.857841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:51.858524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:51.858982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:51.859505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:51.863341 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:51.863829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:51.864373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:51.865064 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:51.865520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:51.865944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:52.051211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:52.054135 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:52.058697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4f39404f-02d5-4ca2-b8b1-a88f725e23d8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1364 microversion: 2.1 time: 0.212085 Aug 06 20:38:52.059293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 119/237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:51 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:52.062154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-48611c3a-7a9e-4882-a383-71395feb7ea1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.209125 Aug 06 20:38:52.063031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 119/238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:51 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:52.064097 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:52.064885 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:52.070449 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:52.070926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:52.071383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:52.072061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:52.072507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:52.072924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:52.196661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:52.205911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-624ae653-9dd4-4566-b18c-a763f2fcbccc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1557 microversion: 2.1 time: 0.145100 Aug 06 20:38:52.214825 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 120/239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:52 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:52.226673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:52.227164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:52.232968 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:52.233453 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:52.233890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:52.234575 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:52.235203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:52.235658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:52.350398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-13f9d90a-5b00-4d58-9cf5-d7fe4a6d064a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127452 Aug 06 20:38:52.350996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 120/240] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:38:52 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:53.078804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:53.079722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:53.082211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:53.082904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:53.086114 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.086602 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.087029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.087994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.088454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.088858 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.089513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.090039 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.090537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.091318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.091995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.092483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.301594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:53.308626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:53.317525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-82eeccc2-b964-4018-8a08-8312826a0302 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1550 microversion: 2.1 time: 0.242452 Aug 06 20:38:53.318111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 121/241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:53 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1550 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:53.332401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3a73567d-624e-4eae-ab2a-cc2f06334eb4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.254278 Aug 06 20:38:53.343005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 121/242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:53 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:53.343198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:53.343198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:53.343920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a98d79f8-8db9-41f3-9738-ec58f5d2ca88"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:53.343920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:53.346342 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.347069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.347726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.348710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.349181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.349614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.349917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.350415 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.350854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.351595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.352105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.352533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.479852 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3430a642-67ea-4ac3-952a-1e44ebdc111c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145225 Aug 06 20:38:53.480525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 122/243] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:38:53 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:53.789306 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-3aa78ede-79cb-449c-af43-4b353e0f5c4b req-e43f691b-e0c4-4c16-b38b-d56ea1cfa632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46acb22e-5b82-4d53-adae-81e616c05c32", "tag": "1e3edbbc-c6e8-46ad-99c0-ad3fc7356693"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:53.800310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3aa78ede-79cb-449c-af43-4b353e0f5c4b req-e43f691b-e0c4-4c16-b38b-d56ea1cfa632 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:53.800945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3aa78ede-79cb-449c-af43-4b353e0f5c4b req-e43f691b-e0c4-4c16-b38b-d56ea1cfa632 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:53.801476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3aa78ede-79cb-449c-af43-4b353e0f5c4b req-e43f691b-e0c4-4c16-b38b-d56ea1cfa632 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:53.813982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-3aa78ede-79cb-449c-af43-4b353e0f5c4b req-e43f691b-e0c4-4c16-b38b-d56ea1cfa632 service nova] Creating event network-changed:1e3edbbc-c6e8-46ad-99c0-ad3fc7356693 for instance 46acb22e-5b82-4d53-adae-81e616c05c32 on hv-cinder-85199 Aug 06 20:38:53.819846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-3aa78ede-79cb-449c-af43-4b353e0f5c4b req-e43f691b-e0c4-4c16-b38b-d56ea1cfa632 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034190 Aug 06 20:38:53.824136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 123/244] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:38:54.355994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:54.357478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:54.365264 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:54.366337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:54.367047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:54.368167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:54.368845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:54.369643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:54.722488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:54.729293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b1746370-3da5-4a93-b32b-6dd85680a836 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.376787 Aug 06 20:38:54.729293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 124/245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:54 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:38:55.110905 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8e25098b-5cda-4ae0-a3b6-cb0d9f4b46bc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "POST /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.773754 Aug 06 20:38:55.112398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 122/246] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:38:53 2022] POST /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5/os-volume_attachments => generated 194 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:55.707444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-635a72f8-ade1-49a1-b816-8eae84e78089 req-d488f535-4cf3-4a2d-94d3-7b623a077778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72752a0b-3b0b-428e-b578-4958b8a51a1b", "tag": "3533274d-9341-439a-8e8f-6ff119c5b8e3"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:55.717569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-635a72f8-ade1-49a1-b816-8eae84e78089 req-d488f535-4cf3-4a2d-94d3-7b623a077778 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:55.718088 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-635a72f8-ade1-49a1-b816-8eae84e78089 req-d488f535-4cf3-4a2d-94d3-7b623a077778 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:55.718550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-635a72f8-ade1-49a1-b816-8eae84e78089 req-d488f535-4cf3-4a2d-94d3-7b623a077778 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:55.729504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-635a72f8-ade1-49a1-b816-8eae84e78089 req-d488f535-4cf3-4a2d-94d3-7b623a077778 service nova] Creating event network-changed:3533274d-9341-439a-8e8f-6ff119c5b8e3 for instance 72752a0b-3b0b-428e-b578-4958b8a51a1b on hv-cinder-85199 Aug 06 20:38:55.735418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-635a72f8-ade1-49a1-b816-8eae84e78089 req-d488f535-4cf3-4a2d-94d3-7b623a077778 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032360 Aug 06 20:38:55.736297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 125/247] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:38:55.753967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:55.754660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:55.766040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:55.766542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:55.767024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:55.767826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:55.768287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:55.768836 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:55.956304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:55.967892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-21706250-a962-444c-9a91-343067a8cd99 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1322 microversion: 2.1 time: 0.218656 Aug 06 20:38:55.969605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 123/248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:55 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:56.994625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:56.996075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:57.010782 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:57.011675 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:57.012274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:57.013158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:57.013765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:57.014628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:57.207816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:57.217015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-de73f9c1-4bd4-4b1e-9450-da2879197753 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1515 microversion: 2.1 time: 0.230152 Aug 06 20:38:57.219367 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 126/249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:56 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:57.239891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:38:57.243585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:57.256335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:57.256335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:57.256335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:57.256335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:57.256673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:57.257057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:57.290880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lazy-loading 'flavor' on Instance uuid 8d7e3d25-df60-4e49-9e80-4378cc82513f {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:38:57.447651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-36cab325-4341-4b35-91d5-af129872d723 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f/action" status: 200 len: 32 microversion: 2.1 time: 0.212074 Aug 06 20:38:57.448803 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 124/250] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:38:57 2022] POST /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:38:57.458819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:57.459530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:57.466152 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:57.466868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:57.467553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:57.468438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:57.468994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:57.469520 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:57.926413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:57.936656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-00fe9dad-fc20-4c2e-a8df-7556f44f7cc1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.481981 Aug 06 20:38:57.950232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 127/251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:57 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:38:58.960369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:38:58.961744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:38:58.970060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:58.970594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:58.971259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:58.972132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:38:58.972587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:38:58.973053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:38:59.118284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:38:59.139299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-585ca34d-2df4-4149-a756-3c1a4795169a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.184055 Aug 06 20:38:59.140979 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 125/252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:38:58 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:00.159859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:00.160499 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:00.166425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:00.166930 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:00.167402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:00.168098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:00.168549 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:00.168973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:00.302145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:00.309652 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-35d43506-e70f-40b8-a8a2-711c4b8efd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.153521 Aug 06 20:39:00.310222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 128/253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:00 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:01.331335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:01.331971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:01.338298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:01.338781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:01.339228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:01.339934 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:01.340390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:01.340822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:01.512519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:01.520946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-824485ce-c3f1-462c-8a75-2a254e586ede tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.194180 Aug 06 20:39:01.521760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 126/254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:01 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:02.542853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:02.544114 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:02.551000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:02.551523 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:02.551946 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:02.552823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:02.553278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:02.553778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:02.797668 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:02.805847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-688e6c83-0e1d-4d3a-be0e-d50ea29fd34d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.267228 Aug 06 20:39:02.806575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 129/255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:02 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:03.828137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:03.828744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:03.835501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:03.835921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:03.836348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:03.837024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:03.837473 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:03.837918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:03.964746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:03.973147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1ebe61be-e29d-4cbd-b9d1-df5af6b3c8cb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.148706 Aug 06 20:39:03.973849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 127/256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:03 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:04.994667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:04.995347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:05.001692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:05.002250 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:05.002876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:05.004163 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:05.004851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:05.005628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:05.145172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:05.152639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2490a60b-3c00-4832-905f-49f3dd8fe828 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.161755 Aug 06 20:39:05.153207 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 130/257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:04 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:06.173839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:06.174442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:06.180798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:06.181283 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:06.181718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:06.182406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:06.182856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:06.183299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:06.309365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:06.317550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-13fba3a7-10cd-433d-8684-9c5a72741140 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.148105 Aug 06 20:39:06.318142 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 128/258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:06 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:07.338596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:07.339133 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:07.345644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:07.346127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:07.346559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:07.347257 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:07.347722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:07.348142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:07.473717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:07.480996 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-40901c0c-f599-4634-9765-7f3b65146cab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.146267 Aug 06 20:39:07.481555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 131/259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:07 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:08.501908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:08.502510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:08.508840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:08.509338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:08.509768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:08.510468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:08.510925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:08.511379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:08.646685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:08.654452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-255fd3a5-a5aa-4241-a4a9-f189306e52e6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.156830 Aug 06 20:39:08.655131 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 129/260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:08 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:09.674965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:09.675596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:09.681707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:09.682334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:09.682825 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:09.683541 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:09.684075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:09.684502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:09.822387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:09.829881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c6ca5a05-42d7-402f-9adf-bdf39d3c7ded tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.159273 Aug 06 20:39:09.830430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 132/261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:09 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:10.851415 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:10.852079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:10.858494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:10.859597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:10.860034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:10.860731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:10.861207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:10.861614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:11.000351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:11.008393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a91442cc-b9dd-421f-b07a-584cde25cd82 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.160710 Aug 06 20:39:11.008880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 130/262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:10 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:12.028943 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:12.029611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:12.032148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=52 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.037286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:12.037776 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:12.038217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:12.038912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:12.039397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:12.039822 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:12.044317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.167949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:12.175266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1cc64409-344b-490c-858d-1c0b7e213898 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.150397 Aug 06 20:39:12.175841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 133/263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:12 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:12.574857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:12.575492 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:12.584593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:12.585329 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:12.585799 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:12.586619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:12.587392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:12.588444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:12.620638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Going to try to terminate instance {{(pid=129475) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:39:12.623965 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.724897 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-dfe75574-d4ad-4d3c-957c-4deaaa5ca2d5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 204 len: 0 microversion: 2.1 time: 0.153801 Aug 06 20:39:12.725638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 131/264] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:39:12 2022] DELETE /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:39:12.738058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:12.738911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:12.747492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:12.747982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:12.748579 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:12.749932 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:12.750389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:12.750816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:12.899794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:12.914229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-72584e99-7213-41a2-980e-9559847119c5 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1554 microversion: 2.1 time: 0.180466 Aug 06 20:39:12.914895 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 134/265] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:12 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:13.196754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:13.197436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:13.203877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:13.204536 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:13.205161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:13.206099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:13.206700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:13.207300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:13.430371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:13.441873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a1dc8eb9-6ebf-4918-8361-de25cb5ef296 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.248068 Aug 06 20:39:13.443469 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 132/266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:13 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:13.935193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:13.937033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:13.944527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:13.945024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:13.945462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:13.946543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:13.947553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:13.948545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:14.105750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:14.114757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e190ad38-091f-4ab3-9242-94829b757780 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1554 microversion: 2.1 time: 0.183896 Aug 06 20:39:14.115360 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 135/267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:13 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:14.469704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:14.470317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:14.476998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:14.477495 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:14.478187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:14.479059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:14.479857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:14.480476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:14.647353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:14.655050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f2fe0acd-8cb8-4798-b4ab-dd6a3341c2e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.188951 Aug 06 20:39:14.655755 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 133/268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:14 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:15.136069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:15.137278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:15.144131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:15.144740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:15.145387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:15.146230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:15.146815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:15.147376 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:15.325288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:15.334118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-531829ce-9a3c-4916-a096-f784414c7620 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1554 microversion: 2.1 time: 0.201872 Aug 06 20:39:15.335682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 136/269] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:15 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:15.676455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:15.677069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:15.683736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:15.684242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:15.684671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:15.685373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:15.685846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:15.686526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:15.911364 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:15.921550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2422edc0-7251-4b56-8697-18fef768b6e8 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.248467 Aug 06 20:39:15.933695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 134/270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:15 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:16.357414 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:16.359611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:16.371037 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:16.371862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:16.372363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:16.373082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:16.373546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:16.374027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:16.557883 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:16.566994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b07375e2-ad85-4ee8-b5f1-95b189688883 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1554 microversion: 2.1 time: 0.214571 Aug 06 20:39:16.567645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 137/271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:16 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:16.716900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-3ce66391-3a9a-46f7-a163-0e20b9436e08 req-544fb017-a709-491e-b6e0-85ba1a49699e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255f05a-c9a7-4116-8c52-3cc2273ccae5", "name": "network-vif-deleted", "tag": "d8634471-c27b-4ee6-bf62-7f94cd7dbbdf"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:16.730435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-3ce66391-3a9a-46f7-a163-0e20b9436e08 req-544fb017-a709-491e-b6e0-85ba1a49699e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:16.730812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-3ce66391-3a9a-46f7-a163-0e20b9436e08 req-544fb017-a709-491e-b6e0-85ba1a49699e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:16.731307 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-3ce66391-3a9a-46f7-a163-0e20b9436e08 req-544fb017-a709-491e-b6e0-85ba1a49699e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:16.886408 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-3ce66391-3a9a-46f7-a163-0e20b9436e08 req-544fb017-a709-491e-b6e0-85ba1a49699e service nova] Creating event network-vif-deleted:d8634471-c27b-4ee6-bf62-7f94cd7dbbdf for instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 on hv-cinder-85199 Aug 06 20:39:16.892479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-3ce66391-3a9a-46f7-a163-0e20b9436e08 req-544fb017-a709-491e-b6e0-85ba1a49699e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178989 Aug 06 20:39:16.893541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 135/272] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:39:16.944758 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:16.945360 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:16.951140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:16.951652 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:16.952622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:16.953322 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:16.953774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:16.954189 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:17.090768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:17.098756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6ba7a6b2-34ff-4542-922d-84605171effc tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.157729 Aug 06 20:39:17.099338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 138/273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:16 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:17.150341 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1688571158", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "networks": [{"uuid": "544b3ff7-a7cd-4e20-8ac7-20760c8ec275"}]}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:17.159442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:17.204643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] validate_networks() for [('544b3ff7-a7cd-4e20-8ac7-20760c8ec275', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:39:17.546819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:39:17.547292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:39:17.547764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:39:17.548169 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:39:17.548575 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:39:17.557287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:17.557772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:17.558206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:17.558950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:17.559412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:17.559856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:17.577101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Getting quotas for project f2b62ba61aeb459eade55243a8187505. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:39:17.584814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Getting quotas for user 0b1c65231a70438fb722d0e544735526 and project f2b62ba61aeb459eade55243a8187505. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:39:17.588198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:17.588801 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:17.595624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:17.596105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:17.596700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:17.597260 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:39:17.597389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:17.597839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:17.598254 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:17.599624 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:39:17.645285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5b0ec461-0e43-44dc-a754-7f82c70037cd tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498907 Aug 06 20:39:17.659372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 136/274] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:39:17.673054 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-82c2fc08-0b9f-4f92-b609-9ecb1bcdbb7a tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:17.674421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-82c2fc08-0b9f-4f92-b609-9ecb1bcdbb7a tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:17.680341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd39e95dd7b6e4055842699bbc54c39f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a780800618e549c6b01ef67dd64333c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:17.694396 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-eaa6bb35-c1ad-413a-ad3e-21f9ed8c6d8f tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 200 len: 1346 microversion: 2.1 time: 0.109899 Aug 06 20:39:17.695226 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 139/275] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:17 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:17.739177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-82c2fc08-0b9f-4f92-b609-9ecb1bcdbb7a tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:17.752687 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-82c2fc08-0b9f-4f92-b609-9ecb1bcdbb7a tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1219 microversion: 2.1 time: 0.084003 Aug 06 20:39:17.753273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 137/276] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:17 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:18.119629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:18.120159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:18.126550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.127020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.127480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.128167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.128622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.129044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.257548 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:18.266288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-231d14ab-2f4e-4cdb-a244-7c27a46e9a86 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.150571 Aug 06 20:39:18.266870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 140/277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:18 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:18.719617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:18.720355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:18.728268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.728756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.729298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.729988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.730436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.730856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.745287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] HTTP exception thrown: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Request method failure captured: Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 HTTP/1.1 Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tD9J5dm4t6VoM1GXzP7OK3w-czEHBVeYUfSEGFckpip4xsjuFMNcreh3LiQ-p15vhMeHOLkZTRrOsVksKBTqGIB_qZ1jDRn4cWov8yYjSX0Uw8lju2OwV3qDFKocY8Qk9065SXtMXEEuER2hT85ImVdKPTSKedQ8ZnKhhkua1WLSBU Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:39:18.750190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a780800618e549c6b01ef67dd64333c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: d39e95dd7b6e4055842699bbc54c39f5 Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.751747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '2255f05a-c9a7-4116-8c52-3cc2273ccae5'} Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:39:18.752509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.753609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.754620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Returning 404 to user: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:39:18.754620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-be343e36-11f6-46fa-96a8-5178800dcac3 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 404 len: 111 microversion: 2.1 time: 0.039753 Aug 06 20:39:18.754620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 138/278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:18 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:39:18.777476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:18.778367 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:18.784571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.785290 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.785726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.786403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.787126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.787583 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.866879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:18.875932 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c9e20ef6-7f16-40ab-9b2d-034b9829c518 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1271 microversion: 2.1 time: 0.102543 Aug 06 20:39:18.876904 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 141/279] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:18 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:18.930422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:18.932850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:18.940165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.940735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.941238 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.941996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:18.942519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:18.943034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:18.955288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] HTTP exception thrown: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Request method failure captured: Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5/os-volume_attachments HTTP/1.1 Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tD9J5dm4t6VoM1GXzP7OK3w-czEHBVeYUfSEGFckpip4xsjuFMNcreh3LiQ-p15vhMeHOLkZTRrOsVksKBTqGIB_qZ1jDRn4cWov8yYjSX0Uw8lju2OwV3qDFKocY8Qk9065SXtMXEEuER2hT85ImVdKPTSKedQ8ZnKhhkua1WLSBU Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:39:18.957829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a780800618e549c6b01ef67dd64333c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: d39e95dd7b6e4055842699bbc54c39f5 Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.959262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'server_id': '2255f05a-c9a7-4116-8c52-3cc2273ccae5'} Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:39:18.960036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:18.961073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:18.963155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Returning 404 to user: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:39:18.963155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-779b98ed-3547-426a-8a9e-ed53267235fa tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033033 Aug 06 20:39:18.963155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 139/280] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:39:18 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:39:19.287021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:19.289297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:19.296793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:19.297507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:19.298111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:19.299397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:19.299998 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:19.300586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:19.515413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:19.523854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3be2e300-498c-49da-afd5-7abc9a1c9aa2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.240582 Aug 06 20:39:19.524420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 142/281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:19 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:19.896372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:19.897539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:19.903958 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:19.904440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:19.904870 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:19.905608 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:19.906368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:19.906796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.158891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:20.171891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8d8c3ff6-f056-41e3-a6fa-bc868e5aaa08 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.279018 Aug 06 20:39:20.172673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 140/282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:19 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:20.209315 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:20.210454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:20.216581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.217064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.217492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.218781 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.219229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.219685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.237509 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] HTTP exception thrown: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Request method failure captured: Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 HTTP/1.1 Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tD9J5dm4t6VoM1GXzP7OK3w-czEHBVeYUfSEGFckpip4xsjuFMNcreh3LiQ-p15vhMeHOLkZTRrOsVksKBTqGIB_qZ1jDRn4cWov8yYjSX0Uw8lju2OwV3qDFKocY8Qk9065SXtMXEEuER2hT85ImVdKPTSKedQ8ZnKhhkua1WLSBU Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:39:20.242561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a780800618e549c6b01ef67dd64333c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: d39e95dd7b6e4055842699bbc54c39f5 Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.244028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '2255f05a-c9a7-4116-8c52-3cc2273ccae5'} Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:39:20.244819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.246105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.247569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Returning 404 to user: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:39:20.248449 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-683ff344-dda5-4c87-8075-f4146b78b626 tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 404 len: 111 microversion: 2.1 time: 0.044213 Aug 06 20:39:20.249927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 143/283] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:39:20 2022] DELETE /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:39:20.258695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:20.264995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] [instance: 2255f05a-c9a7-4116-8c52-3cc2273ccae5] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:20.274288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.275106 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.275651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.276465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.277060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.277558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.291962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] HTTP exception thrown: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Request method failure captured: Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 HTTP/1.1 Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tD9J5dm4t6VoM1GXzP7OK3w-czEHBVeYUfSEGFckpip4xsjuFMNcreh3LiQ-p15vhMeHOLkZTRrOsVksKBTqGIB_qZ1jDRn4cWov8yYjSX0Uw8lju2OwV3qDFKocY8Qk9065SXtMXEEuER2hT85ImVdKPTSKedQ8ZnKhhkua1WLSBU Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:39:20.294764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a780800618e549c6b01ef67dd64333c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a780800618e549c6b01ef67dd64333c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: a780800618e549c6b01ef67dd64333c4 Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-DeleteServersTestJSON-1368623504 Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: d39e95dd7b6e4055842699bbc54c39f5 Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-DeleteServersTestJSON-1368623504-project Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.296036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '2255f05a-c9a7-4116-8c52-3cc2273ccae5'} Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:39:20.296756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. Aug 06 20:39:20.297944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:39:20.299220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] Returning 404 to user: Instance 2255f05a-c9a7-4116-8c52-3cc2273ccae5 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:39:20.299220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-316998cf-c239-4749-aa55-8fbcee2b37dc tempest-DeleteServersTestJSON-1368623504 tempest-DeleteServersTestJSON-1368623504-project] 10.222.0.17 "GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5" status: 404 len: 111 microversion: 2.1 time: 0.041821 Aug 06 20:39:20.299220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 141/284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:20 2022] GET /compute/v2.1/servers/2255f05a-c9a7-4116-8c52-3cc2273ccae5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:39:20.547586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:20.547586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:20.553631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.554309 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.554749 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.555526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.555984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.556406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:20.813246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:20.824424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-512cdde5-56e0-408c-a038-87d8b0e3893d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.282837 Aug 06 20:39:20.825034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 144/285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:20 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:20.986820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-5b3ac912-5ba4-4769-a9e7-8b01f09fa574 req-b91b7008-2867-4e8d-b3c5-a35fec90e5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73235c7f-4635-48c9-a4d7-c4634a769ff7", "tag": "3f80acae-1409-41a8-b7be-2313a53ea5bc"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:20.997684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5b3ac912-5ba4-4769-a9e7-8b01f09fa574 req-b91b7008-2867-4e8d-b3c5-a35fec90e5b4 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:20.998154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5b3ac912-5ba4-4769-a9e7-8b01f09fa574 req-b91b7008-2867-4e8d-b3c5-a35fec90e5b4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:20.998743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5b3ac912-5ba4-4769-a9e7-8b01f09fa574 req-b91b7008-2867-4e8d-b3c5-a35fec90e5b4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:21.010785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-5b3ac912-5ba4-4769-a9e7-8b01f09fa574 req-b91b7008-2867-4e8d-b3c5-a35fec90e5b4 service nova] Creating event network-changed:3f80acae-1409-41a8-b7be-2313a53ea5bc for instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 on hv-cinder-85199 Aug 06 20:39:21.021400 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-5b3ac912-5ba4-4769-a9e7-8b01f09fa574 req-b91b7008-2867-4e8d-b3c5-a35fec90e5b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037230 Aug 06 20:39:21.022599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 142/286] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:39:21.193509 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:21.194123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:21.200797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:21.201291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:21.201727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:21.202436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:21.202892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:21.203344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:21.656809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:21.664581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d8c22ff1-69a2-44a4-834e-041eff989cc5 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.475336 Aug 06 20:39:21.665151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 145/287] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:21 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:21.860502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:21.861715 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:21.868746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:21.869485 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:21.869783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:21.870412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:21.871056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:21.871709 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:22.145165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:22.164069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c2190008-f4da-4ad2-a4a8-e3881d1a89a7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.308255 Aug 06 20:39:22.165179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 143/288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:21 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:22.685365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:22.686002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:22.692353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:22.692859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:22.693288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:22.693989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:22.694424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:22.694839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:22.844518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:22.855217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6f1edc09-2f36-4ca9-9a4f-251511981b19 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.173573 Aug 06 20:39:22.856676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 146/289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:22 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:23.187209 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:23.188109 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:23.194707 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:23.195192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:23.195848 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:23.196795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:23.197651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:23.198090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:23.375691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:23.384335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c42b043e-766e-4682-a4d0-cf786b718727 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.202024 Aug 06 20:39:23.385054 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 144/290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:23 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:23.877009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:23.877708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:23.883650 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:23.884212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:23.884717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:23.885583 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:23.886046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:23.886474 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:24.143374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:24.152411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1ac09c80-bf24-45ad-a4b5-d4963bd018c0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.279289 Aug 06 20:39:24.152988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 147/291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:23 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:24.405767 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:24.406384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:24.412861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:24.413700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:24.414309 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:24.415307 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:24.422611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:24.423353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:24.619838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:24.628350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9efb8893-2d76-42f2-9a41-be4f4faa6db6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.227077 Aug 06 20:39:24.640449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 145/292] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:24 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:25.175434 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:25.175924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:25.182427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:25.182922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:25.183557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:25.184268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:25.184795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:25.185417 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:25.650197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:25.650822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:25.662261 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:25.664892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:25.665863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:25.666907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:25.667944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:25.668578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:25.855583 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:25.870042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5eaf3ff3-fe18-41fc-ba9b-848844c28b8d tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.700117 Aug 06 20:39:25.871252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 148/293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:25 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:25.980011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:25.992960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-15d600d5-d5d3-4727-a2e0-2f7047dfb2c0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.346447 Aug 06 20:39:26.005457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 146/294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:25 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:26.891471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:26.892921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:26.899317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:26.899890 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:26.900393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:26.901158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:26.901701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:26.902195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:27.016245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:27.017046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:27.024282 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:27.024833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:27.025268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:27.026374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:27.026843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:27.027257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:27.091542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:27.101431 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dedaf681-5d1c-4d7e-9733-eac851aae2b0 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.213933 Aug 06 20:39:27.102335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 149/295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:26 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:27.184255 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:27.193107 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9f146430-3dc8-4509-8a86-493ac6380aa3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.180944 Aug 06 20:39:27.194190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 147/296] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:27 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:28.034901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-0b3c53c6-99c4-4715-8b89-ee3cbd062425 req-f8782f78-44d8-460b-bb4c-794e09edd792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73235c7f-4635-48c9-a4d7-c4634a769ff7", "name": "network-vif-plugged", "status": "completed", "tag": "3f80acae-1409-41a8-b7be-2313a53ea5bc"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:28.065969 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-0b3c53c6-99c4-4715-8b89-ee3cbd062425 req-f8782f78-44d8-460b-bb4c-794e09edd792 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:28.066536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-0b3c53c6-99c4-4715-8b89-ee3cbd062425 req-f8782f78-44d8-460b-bb4c-794e09edd792 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:28.067173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-0b3c53c6-99c4-4715-8b89-ee3cbd062425 req-f8782f78-44d8-460b-bb4c-794e09edd792 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:28.084401 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-0b3c53c6-99c4-4715-8b89-ee3cbd062425 req-f8782f78-44d8-460b-bb4c-794e09edd792 service nova] Creating event network-vif-plugged:3f80acae-1409-41a8-b7be-2313a53ea5bc for instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 on hv-cinder-85199 Aug 06 20:39:28.091565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-0b3c53c6-99c4-4715-8b89-ee3cbd062425 req-f8782f78-44d8-460b-bb4c-794e09edd792 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062094 Aug 06 20:39:28.093000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 150/297] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:39:28.124787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:28.126070 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:28.139104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.140895 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=8 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.144651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:28.145610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:28.146452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:28.147794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:28.148613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:28.149283 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:28.219538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:28.220270 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:28.229645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:28.234378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:28.234899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:28.236039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:28.236693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:28.237286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:28.240605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:28.550229 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:28.569017 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8a5f4be5-5b9b-43f9-86be-20dc56a34ee6 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.450410 Aug 06 20:39:28.592700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 148/298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:28 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:28.594637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:28.608214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7526f582-65c8-4543-ba12-132e32db6bfa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.393873 Aug 06 20:39:28.610321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 151/299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:28 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:29.590547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:29.591172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:29.605598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:29.606278 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:29.606730 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:29.609318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:29.609318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:29.609318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:29.633198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:29.634463 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:29.653785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:29.655443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:29.656085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:29.657016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:29.657665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:29.658310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:30.243439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:30.244369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:30.261683 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3bc4c3a5-6203-4c3f-83d8-d85ac137df4d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.632273 Aug 06 20:39:30.275280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6be8b6d7-b3ee-424f-b7f5-1267cdb3f255 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1319 microversion: 2.1 time: 0.679432 Aug 06 20:39:30.280077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 152/300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:29 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:30.280258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 149/301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:29 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1319 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:31.283659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:31.284848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:31.285713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:31.286326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:31.292407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:31.293142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:31.293785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:31.297402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:31.298104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:31.299002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:31.299612 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:31.300393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:31.301030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:31.301967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:31.302438 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:31.311735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:31.645494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:31.656750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-09e7c493-fc7e-4f09-8731-6aae2a3274f6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.376548 Aug 06 20:39:31.670884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 153/302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:31 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:31.681538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:31.697532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-af455608-c6d2-4724-b53f-0709de7d43ee tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1508 microversion: 2.1 time: 0.415544 Aug 06 20:39:31.699030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 150/303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:31 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:32.007896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7f60449d-ccef-4774-abc6-f44aae750b6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'create', calling method: .version_select at 0x7fba96983430>, body: {"keypair": {"name": "tempest-keypair-522453546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxoQSfmK2k/hKEWvzxbZZe+n0WgvH+mCwUAAMk6LSUuW5sgfJ0lrydGk2njfccgsMd+I/xIIBVpLt3StB4vSoXouRnXU/emckH9PbTrqPqQ0oNLwUhaSsM/TAv2HERTqA=="}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:32.029588 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-7f60449d-ccef-4774-abc6-f44aae750b6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:39:32.033833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-7f60449d-ccef-4774-abc6-f44aae750b6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for user 8dcb94f981244d569f1dd791a4d911ac and project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:39:32.079661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7f60449d-ccef-4774-abc6-f44aae750b6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.210936 Aug 06 20:39:32.083444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 154/304] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Aug 6 20:39:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 20:39:32.678448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:32.679197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:32.686442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:32.687138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:32.687907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:32.688449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:32.688755 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:32.689355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:32.901469 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:32.905122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:32.910125 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c0a2275d-a0fd-419c-897d-4306f95dd16a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.235772 Aug 06 20:39:32.910690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 151/305] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:32 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:33.459601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-965306461", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c6ef45e-275a-4453-acaf-29d4869697fb"}], "security_groups": [{"name": "tempest-securitygroup--1199076328"}], "key_name": "tempest-keypair-522453546", "user_data": "}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:33.932206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:33.932820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:33.940253 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:33.941027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:33.941463 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:33.942173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:33.942615 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:33.943037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:34.076788 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:34.085021 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-aba86c60-cfed-4ecf-a98b-eeeaa36600ea tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.157165 Aug 06 20:39:34.091644 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 152/306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:33 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:35.105992 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:35.106660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:35.114235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:35.114743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:35.115201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:35.115957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:35.116420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:35.116919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:35.252472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:35.260489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6df63984-0a73-40c4-bb4f-72742f1059f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.158230 Aug 06 20:39:35.261244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 153/307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:35 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:36.289181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:36.289863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:36.296175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:36.296660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:36.297097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:36.297782 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:36.298242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:36.298663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:36.439108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:36.446862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6cdd23c7-55fd-48db-a360-5354f7be8f8b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.161480 Aug 06 20:39:36.447459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 154/308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:36 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:37.468610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:37.469232 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:37.480087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:37.480765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:37.481204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:37.481903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:37.482711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:37.483880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:37.626970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:37.635724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-718288d1-7e9a-4d0e-b209-1ee6d6afc681 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.171316 Aug 06 20:39:37.636297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 155/309] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:37 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:38.658970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:38.659805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:38.667091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:38.667780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:38.668223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:38.668930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:38.669418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:38.669844 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:38.802396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:38.810025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-761387be-c8a7-444e-9886-a079e9227568 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.155731 Aug 06 20:39:38.810613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 156/310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:38 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:39.833229 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:39.833912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:39.840374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:39.840864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:39.841298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:39.842497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:39.842957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:39.843416 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:39.974188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:39.981608 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-86b31cc8-b9b6-47d0-8933-1fc7a618f77e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.152533 Aug 06 20:39:39.982172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 157/311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:39 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:41.002543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:41.003222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:41.009794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:41.010279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:41.010749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:41.011599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:41.012068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:41.012505 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:41.146155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:41.153790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-069b8168-bd53-4aed-9031-1e9ce35a8ee9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.155251 Aug 06 20:39:41.154369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 158/312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:40 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:41.650196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=17 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:42.040410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=4 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:42.175971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:42.176617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:42.182985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:42.183514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:42.183954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:42.184686 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:42.185144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:42.185568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:42.407563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:42.416116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6dd6a2fa-b50b-45c6-ab13-64ad9a17144c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.243982 Aug 06 20:39:42.416696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 159/313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:42 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:43.440424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:43.441035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:43.447100 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:43.447634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:43.448159 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:43.448849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:43.449309 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:43.449729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:43.471363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.594591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:43.602389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a07c4ff1-acec-43b5-a0fb-9b3a2b0759f3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.166472 Aug 06 20:39:43.603102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 160/314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:43 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:39:43.796806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] validate_networks() for [('9c6ef45e-275a-4453-acaf-29d4869697fb', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:39:44.189098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:39:44.189521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:39:44.190119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:39:44.190527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:39:44.190934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:39:44.203439 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:44.203920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:44.204351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:44.205070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:44.205521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:44.206227 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:44.223820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:39:44.227965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for user 8dcb94f981244d569f1dd791a4d911ac and project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:39:44.238837 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:39:44.241129 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:39:44.289888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ea86c92c-5d19-497d-b520-f283974f0977 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 10.834864 Aug 06 20:39:44.290752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 155/315] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Aug 6 20:39:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 10836 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:39:44.302150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-382a8bfc-7f6c-4823-9ae5-aaaae712d05d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:44.302765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-382a8bfc-7f6c-4823-9ae5-aaaae712d05d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:44.356534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-382a8bfc-7f6c-4823-9ae5-aaaae712d05d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:44.364390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-382a8bfc-7f6c-4823-9ae5-aaaae712d05d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:44.365899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-382a8bfc-7f6c-4823-9ae5-aaaae712d05d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:44.367156 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-382a8bfc-7f6c-4823-9ae5-aaaae712d05d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1280 microversion: 2.20 time: 0.068853 Aug 06 20:39:44.367979 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 161/316] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:44 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:44.623715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:44.624473 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:44.630703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:44.631279 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:44.631719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:44.632403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:44.632853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:44.633273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:44.770922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:44.778380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8d306da9-94c3-40ab-8970-da7169b33062 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.158674 Aug 06 20:39:44.778939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 156/317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:44 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:45.390913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:45.391586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:45.398118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:45.398580 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:45.399053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:45.399804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:45.400294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:45.400751 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:45.462422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:45.470379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:45.471936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:45.473032 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-01b299ce-829b-45d4-8317-21a3bf165639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1284 microversion: 2.20 time: 0.086802 Aug 06 20:39:45.473590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 162/318] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:45 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:45.799854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:45.800436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:45.806162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:45.806642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:45.807072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:45.807780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:45.808228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:45.808656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:45.940921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:45.948924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fb93f94e-6a9c-4940-9661-63bb1d7029fa tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.153573 Aug 06 20:39:45.949481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 157/319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:45 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:46.497890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:46.500344 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:46.512849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:46.513735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:46.515053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:46.516230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:46.517058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:46.517832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:46.589713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:46.598229 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:46.599770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:46.600874 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9cf58ff9-48ca-4e5d-b7d5-93c996f2842c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1332 microversion: 2.20 time: 0.108602 Aug 06 20:39:46.604170 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 163/320] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:46 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:46.970595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:46.971210 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:46.977572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:46.978060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:46.978502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:46.979203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:46.979689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:46.980117 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:47.107789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:47.115104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5a5a1032-44ab-4e88-81e6-76a76dba72e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.148888 Aug 06 20:39:47.115693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 158/321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:46 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:47.623326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:47.624075 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:47.626912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:47.635008 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:47.635833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:47.636582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:47.637338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:47.637861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:47.638346 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:47.704370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:47.712722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:47.714243 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:47.715360 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3377c71a-e9d7-43a2-a8be-f8fb012e5784 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1340 microversion: 2.20 time: 0.096778 Aug 06 20:39:47.715912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 164/322] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:47 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:39:48.135932 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:48.136644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:48.142867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:48.143391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:48.143834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:48.144521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:48.144972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:48.145421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:48.343839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:48.353130 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d1c10023-eeda-48a3-8546-206ec3b06e7d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1521 microversion: 2.1 time: 0.220884 Aug 06 20:39:48.353918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 159/323] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:48 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:48.740176 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:48.740954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:48.748147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:48.748950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:48.749498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:48.750513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:48.751315 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:48.751962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:48.945737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:48.955329 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:48.957448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:48.958887 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d66c6cce-7b43-4953-89cd-46efbfc0bd62 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1338 microversion: 2.20 time: 0.224079 Aug 06 20:39:48.959622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 165/324] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:48 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:49.378229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:49.379980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:49.389681 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.390571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.391074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:49.391987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.392502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.393150 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:49.585676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:49.593466 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-97c96425-e92b-4a01-99ef-b09445171ef9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1501 microversion: 2.1 time: 0.222354 Aug 06 20:39:49.594037 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 160/325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:49 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:49.613520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:49.614057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:49.620003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.620489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.620925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:49.621680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.622143 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.622569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:49.843589 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:49.851174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-82f1d933-ae7d-439e-bc1e-e851e2143ec9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1514 microversion: 2.1 time: 0.241536 Aug 06 20:39:49.851776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 166/326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:49 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:49.897772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-9808d036-ad90-42d6-8e2d-e9dd1cdae81d req-4e2072f6-becc-4572-9902-c0043237b70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:49.911610 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9808d036-ad90-42d6-8e2d-e9dd1cdae81d req-4e2072f6-becc-4572-9902-c0043237b70d service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.913031 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9808d036-ad90-42d6-8e2d-e9dd1cdae81d req-4e2072f6-becc-4572-9902-c0043237b70d service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.913480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9808d036-ad90-42d6-8e2d-e9dd1cdae81d req-4e2072f6-becc-4572-9902-c0043237b70d service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:49.929159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-9808d036-ad90-42d6-8e2d-e9dd1cdae81d req-4e2072f6-becc-4572-9902-c0043237b70d service nova] Creating event network-changed:b73fc326-7095-42f3-9b6f-f9cae7cc05ce for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 on hv-cinder-85199 Aug 06 20:39:49.936285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-9808d036-ad90-42d6-8e2d-e9dd1cdae81d req-4e2072f6-becc-4572-9902-c0043237b70d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040333 Aug 06 20:39:49.937304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 161/327] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:39:49.986441 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:49.987059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:49.993019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.993508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.994133 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:49.995029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:49.995670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:49.996094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:50.226549 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:50.234939 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:50.236561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:50.237705 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d04c3cf8-9fdd-4854-80ca-3899a2aef1ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.255695 Aug 06 20:39:50.249385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 167/328] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:49 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:51.260561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:51.261246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:51.267353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:51.267831 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:51.268257 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:51.268933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:51.269384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:51.269802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:51.398212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:51.406679 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:51.408208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:51.409298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5497b0c3-a8d1-45dc-9c8a-57f9663299f8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.153483 Aug 06 20:39:51.409848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 162/329] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:51 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:52.431049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:52.431701 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:52.438711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:52.439206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:52.439678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:52.440371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:52.440833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:52.441258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:52.583643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:52.590055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:52.591619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:52.592726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5edb3057-34ca-44cf-a3f3-72d140d7bf60 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.165583 Aug 06 20:39:52.593280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 168/330] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:52 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:39:53.370692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:53.373484 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:53.379530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:53.380026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:53.380474 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:53.381168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:53.381624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:53.382080 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:53.404777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lazy-loading 'flavor' on Instance uuid 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:39:53.516809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fbc4ed3c-9c90-4be5-b528-d6592f6b15f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/action" status: 200 len: 32 microversion: 2.1 time: 0.150934 Aug 06 20:39:53.517400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 163/331] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:39:53 2022] POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:39:53.526936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:53.527583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:53.533503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:53.533988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:53.534426 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:53.535114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:53.535626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:53.536064 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:53.553317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:53.614781 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:53.615699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:53.628143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:53.628143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:53.628143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:53.628143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:53.628701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:53.628701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:53.705091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:53.712860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a16828b1-a4e3-4c60-ba25-15de18178cfe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.189891 Aug 06 20:39:53.713603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 169/332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:53 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:53.771068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:53.779815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:53.781344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:53.782492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-24623e04-b771-450c-97c0-27f0551d5baa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.171874 Aug 06 20:39:53.783053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 164/333] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:53 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:39:54.733671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:54.734280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:54.736122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.741594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:54.742077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:54.742514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:54.743202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:54.743678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:54.744105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:54.805877 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:54.806498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:54.808437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.809204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:54.815532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:54.816019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:54.816453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:54.817165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:54.817615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:54.818035 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:54.900444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:54.908121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-864780d8-5509-44be-8d98-387433f46064 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.178234 Aug 06 20:39:54.908691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 170/334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:54 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:54.970039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:54.977929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:54.979530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:54.980629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b218d977-b6d2-4694-bae0-3667acdb4363 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.178603 Aug 06 20:39:54.981181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 165/335] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:54 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:39:55.929584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:55.930181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:55.938739 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:55.941778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:55.942236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:55.943472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:55.943873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:55.944304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:56.003522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:56.003958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:56.009652 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:56.010135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:56.010565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:56.011269 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:56.011729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:56.012145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:56.373613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:56.380921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3103547c-5ef9-41a9-99d3-e227aa2d4b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.455113 Aug 06 20:39:56.381481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 171/336] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:55 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:56.407525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:56.416123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:56.417618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:56.418701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-85b53e7e-83a5-42cd-b868-c2e007c59aa5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.419372 Aug 06 20:39:56.419266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 166/337] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:55 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:39:57.401900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:57.402504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:57.409499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:57.410012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:57.410448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:57.411141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:57.411624 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:57.412052 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:57.441609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:57.442212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:57.448466 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:57.448951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:57.449389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:57.450079 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:57.450532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:57.450955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:57.553285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:57.562585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0da968a8-18ad-42c6-96c9-b07060b40c36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.164500 Aug 06 20:39:57.563173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 172/338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:57 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:57.710920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:57.719365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:57.720868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:57.721960 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f9a625bd-092c-40aa-a205-8573ac8f4f83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.284139 Aug 06 20:39:57.722514 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 167/339] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:57 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:39:58.280601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-995462b8-b9f6-4680-86e6-4a779eb7edd8 req-6ff30488-f57d-48dc-b45d-50df3d996529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "name": "network-vif-plugged", "status": "completed", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:39:58.291398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-995462b8-b9f6-4680-86e6-4a779eb7edd8 req-6ff30488-f57d-48dc-b45d-50df3d996529 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:58.291898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-995462b8-b9f6-4680-86e6-4a779eb7edd8 req-6ff30488-f57d-48dc-b45d-50df3d996529 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:58.292325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-995462b8-b9f6-4680-86e6-4a779eb7edd8 req-6ff30488-f57d-48dc-b45d-50df3d996529 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:58.305864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-995462b8-b9f6-4680-86e6-4a779eb7edd8 req-6ff30488-f57d-48dc-b45d-50df3d996529 service nova] Creating event network-vif-plugged:b73fc326-7095-42f3-9b6f-f9cae7cc05ce for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 on hv-cinder-85199 Aug 06 20:39:58.311445 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-995462b8-b9f6-4680-86e6-4a779eb7edd8 req-6ff30488-f57d-48dc-b45d-50df3d996529 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034982 Aug 06 20:39:58.312836 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 173/340] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:39:58.585208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:58.586154 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:58.597888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:58.598389 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:58.598823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:58.599572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:58.600028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:58.600603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:58.730837 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:58.739733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9f7efc32-e1af-4e10-b8fd-052273ac7b35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.159861 Aug 06 20:39:58.740293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 168/341] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:58 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:58.744627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:58.745449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:58.752007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:58.752558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:58.753078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:58.753760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:58.754213 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:58.754630 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:58.885505 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:58.893832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:58.895373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:58.896514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e89a2078-3d64-4e28-afe4-d8ab1106d742 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.156174 Aug 06 20:39:58.897068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 174/342] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:58 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:39:59.760464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:59.761070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:59.767739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:59.768221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:59.768654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:59.769340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:59.769793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:59.770213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:59.897095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:39:59.906574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-361f753a-8e48-49a6-bc19-ca03d5dd74f2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.150078 Aug 06 20:39:59.907330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 169/343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:39:59 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:39:59.922259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:39:59.923327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:39:59.933496 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:59.934336 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:59.935010 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:39:59.936163 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:39:59.936900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:39:59.937593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:00.077601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:00.086117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:00.087664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:00.088753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ece0b7bb-8a74-49cc-a234-c9d19a897bbf tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1406 microversion: 2.20 time: 0.173357 Aug 06 20:40:00.089302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 175/344] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:39:59 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:40:00.927638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:00.928170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:00.933929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:00.934407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:00.934835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:00.936067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:00.936522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:00.936938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:01.063989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:01.068428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:01.074049 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-401288dc-f2e8-418d-94de-d9be54b2075c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.150284 Aug 06 20:40:01.074611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 170/345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:00 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:01.111328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:01.111930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:01.120594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:01.121093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:01.121520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:01.122211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:01.122661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:01.123080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:01.257852 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:01.266595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:01.268158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:01.269314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-09b20221-a1a0-494a-919e-64a8d56c5a4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1598 microversion: 2.20 time: 0.162765 Aug 06 20:40:01.269877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 176/346] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:40:01 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:40:01.292015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:01.292609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:01.299793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:01.300283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:01.300725 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:01.301477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:01.301934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:01.302359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:01.382480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7f765329-2441-4bb2-93fa-c83efaddd854 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095322 Aug 06 20:40:01.383074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 171/347] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Aug 6 20:40:01 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:40:02.095998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:02.096610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:02.102453 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:02.102944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:02.103428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:02.104127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:02.104586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:02.105015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:02.336018 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:02.344632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5fe9307e-d26c-42dd-ac17-d7c5e2821a94 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.253278 Aug 06 20:40:02.355620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 177/348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:02 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:02.626756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-e6d5266a-a6ff-4086-a20b-4bc927ee5015 req-4c205fa2-131c-49f2-b860-95a07d7ad1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:02.636351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-e6d5266a-a6ff-4086-a20b-4bc927ee5015 req-4c205fa2-131c-49f2-b860-95a07d7ad1c6 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:02.636919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-e6d5266a-a6ff-4086-a20b-4bc927ee5015 req-4c205fa2-131c-49f2-b860-95a07d7ad1c6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:02.637297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-e6d5266a-a6ff-4086-a20b-4bc927ee5015 req-4c205fa2-131c-49f2-b860-95a07d7ad1c6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:02.649156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-e6d5266a-a6ff-4086-a20b-4bc927ee5015 req-4c205fa2-131c-49f2-b860-95a07d7ad1c6 service nova] Creating event network-changed:b73fc326-7095-42f3-9b6f-f9cae7cc05ce for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 on hv-cinder-85199 Aug 06 20:40:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-e6d5266a-a6ff-4086-a20b-4bc927ee5015 req-4c205fa2-131c-49f2-b860-95a07d7ad1c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031285 Aug 06 20:40:02.655725 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 172/349] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:03.365938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:03.366624 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:03.373933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:03.374452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:03.374889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:03.375612 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:03.376063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:03.376490 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:03.507055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:03.515269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3cd1c9e4-801d-4f80-89b9-7850cb2d81c3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.153212 Aug 06 20:40:03.516058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 178/350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:03 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:40:04.536665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:04.537366 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:04.543591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:04.544089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:04.545145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:04.545843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:04.546307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:04.546738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:04.680947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:04.688856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fbb4ca1b-9898-44a5-b00c-53882cae249d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.156415 Aug 06 20:40:04.689444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 173/351] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:04 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:05.710398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:05.710938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:05.718224 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:05.718711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:05.719145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:05.719870 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:05.720323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:05.720747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:05.846986 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:05.854419 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2180f967-1ebe-4f04-a067-96a26486cfab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.148975 Aug 06 20:40:05.854982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 179/352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:05 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:06.874147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:06.874694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:06.880737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:06.881220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:06.881656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:06.882341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:06.882798 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:06.883225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:07.013138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:07.020486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3affae69-86e5-49d8-a2b8-d59bc13892f7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.150241 Aug 06 20:40:07.021039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 174/353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:06 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:08.041390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:08.042025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:08.048979 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:08.049491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:08.049928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:08.050612 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:08.051065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:08.051514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:08.178460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:08.186494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f160a4d1-8028-490f-9ca4-a9819e393b30 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.148921 Aug 06 20:40:08.187048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 180/354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:08 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:09.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:09.208848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:09.214685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:09.215167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:09.215638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:09.216326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:09.216784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:09.217207 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:09.342085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:09.349390 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9fe50fc2-0b05-4ca2-8b12-7da4d582ea5c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.145208 Aug 06 20:40:09.349948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 175/355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:09 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:10.370924 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:10.371551 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:10.378967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:10.379501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:10.379940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:10.380657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:10.381224 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:10.381708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:10.516556 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:10.524070 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-52621491-829b-405c-bafd-4e8718c0b63b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.157114 Aug 06 20:40:10.524642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 181/356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:10 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:11.286692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a499cb32-a5c5-4fda-aafc-57fe6c1256fe", "device": "/dev/sdb"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:11.289514 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:11.295923 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:11.296413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:11.296849 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:11.297647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:11.297986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:11.298462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:11.548748 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:11.549360 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:11.555858 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:11.556379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:11.556833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:11.557529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:11.558013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:11.564189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:11.593590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1b5335c8-e79e-4ed1-8189-22881f41789f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "POST /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310583 Aug 06 20:40:11.599334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 176/357] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:40:11 2022] POST /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:11.710189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:11.718346 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5bd631d6-981c-4bd9-8d4f-21531e2b33f4 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.176420 Aug 06 20:40:11.718900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 182/358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:11 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:12.739168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:12.739927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:12.747921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:12.748445 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:12.748878 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:12.749558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:12.750008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:12.750429 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:12.884753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:12.892707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0f236f1e-7ad5-4dc1-9c71-6a64a36aaf36 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.157812 Aug 06 20:40:12.893262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 177/359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:12 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:13.915742 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:13.916290 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:13.922773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:13.923261 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:13.923705 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:13.924392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:13.924842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:13.925263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:14.053826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:14.061211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-965b6f94-9b03-4c1f-95f0-ab480341e92a tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.150586 Aug 06 20:40:14.061771 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 183/360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:13 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:15.082534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:15.083685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:15.086718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:15.093608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:15.094208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:15.094715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:15.095526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:15.095984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:15.096412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:15.273818 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:15.281900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3e74f1c6-094a-4119-a9ea-f2eb51262dc0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.203602 Aug 06 20:40:15.282383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 178/361] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:15 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:16.302426 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:16.302986 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:16.309405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:16.310527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:16.310955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:16.311677 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:16.312125 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:16.312544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:16.447690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:16.455096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9d65b743-9ddc-4768-965d-364db14decb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.156523 Aug 06 20:40:16.455692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 184/362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:16 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:17.476414 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:17.477022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:17.483731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:17.484211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:17.484641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:17.485320 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:17.485769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:17.486186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:17.611773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:17.619162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7453a21c-fb03-42b4-a5ff-742c86068204 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.146555 Aug 06 20:40:17.619742 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 179/363] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:17 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:18.640832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:18.641436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:18.643854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=42 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.649132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.649616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.650042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.650723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.651172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.651617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.783995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:18.791393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9de9c408-3232-4b6c-b3d0-e4b46c86a497 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1500 microversion: 2.1 time: 0.154837 Aug 06 20:40:18.791950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 185/364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:18 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:18.811954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23adfb74-c293-4b6d-8ec5-320f11e2bc8f"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:18.814530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:18.820900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.821390 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.821833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.822524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.822985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.823452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.846167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] HTTP exception thrown: Cannot 'attach_volume' instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d while it is in vm_state rescued Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Request method failure captured: Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/os-volume_attachments HTTP/1.1 Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 74 Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEELyIMRoITCHkzXMoIpQLRdf1oT0v4kcW1kHwW3jNckvrY8Gnnm13WP3_dMbBCCnEEg2PmjgEvBkRpH9ZsGtH-Zd_y0aP9fcqwz1Ovf-H3UHoSYeeQedQPM7aqmQc7DkUWdN3lqybAWABrP-R0V0IHLnyCM5FFNBBQMBtKE74M6EI Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:40:18.848343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 919c94bd42144c9b86fd9977e85b0762 Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {"volumeAttachment": {"volumeId": "23adfb74-c293-4b6d-8ec5-320f11e2bc8f"}} Aug 06 20:40:18.849929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Cannot 'attach_volume' instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d while it is in vm_state rescued Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'server_id': '26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d', 'body': {'volumeAttachment': {'volumeId': '23adfb74-c293-4b6d-8ec5-320f11e2bc8f'}}} Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:40:18.850834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d while it is in vm_state rescued Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:40:18.852556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d while it is in vm_state rescued Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Returning 409 to user: Cannot 'attach_volume' instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d while it is in vm_state rescued {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f5d9434d-eb31-4291-b9b6-99a075b03a7f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042412 Aug 06 20:40:18.854087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 180/365] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:40:18 2022] POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:40:18.858547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:18.859082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:18.864917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.865405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.865846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.866541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.867034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.867499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.893900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:18.930118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-282dff94-e6c5-48cd-99a8-b26fcc7af05b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/action" status: 202 len: 0 microversion: 2.1 time: 0.075189 Aug 06 20:40:18.930729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 186/366] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:40:18 2022] POST /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:40:18.939291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:18.939902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:18.945956 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.946440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.946876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:18.947875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:18.948331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:18.948760 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:19.086953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:19.094794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a9a103aa-05a9-4fbb-a7f7-2bcf4441e02b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.159765 Aug 06 20:40:19.095381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 181/367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:18 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:20.119585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:20.120366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:20.127752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:20.128245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:20.128695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:20.129396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:20.129856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:20.130287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:20.259862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:20.267950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-24419ad9-155f-4d1c-bbd9-4ca4709ffbb0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.154474 Aug 06 20:40:20.268765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 187/368] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:20 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:21.289074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:21.289685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:21.296765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:21.297302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:21.297748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:21.298430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:21.298891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:21.299344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:21.429751 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:21.437245 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3914c557-680d-400e-9570-21fbe153389e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.152040 Aug 06 20:40:21.437804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 182/369] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:21 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:40:22.458273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:22.458883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:22.465313 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:22.466285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:22.466724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:22.467450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:22.467908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:22.468335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:22.596036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:22.603613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9dc49be2-e089-4069-b326-bf47475404a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.149470 Aug 06 20:40:22.604179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 188/370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:22 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:23.625019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:23.625627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:23.632062 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:23.632551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:23.632988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:23.633677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:23.634132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:23.634561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:23.764458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:23.771869 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0cfa4fc3-e730-4656-b4e5-68a81e0e9e05 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.150761 Aug 06 20:40:23.772435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 183/371] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:23 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:24.793283 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:24.794437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:24.800387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:24.800873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:24.801311 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:24.802017 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:24.802456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:24.802882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:24.926583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:24.933994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7bf9a0b9-d6d2-4969-8e4e-687cfe306483 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.144696 Aug 06 20:40:24.934543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 189/372] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:24 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:25.953949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:25.954551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:25.961121 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:25.961589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:25.962022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:25.962705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:25.963159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:25.963603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:26.090405 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:26.097810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4e6511ef-13d0-4cf7-9f40-c5f13b11d612 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.147711 Aug 06 20:40:26.098362 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 184/373] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:25 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:27.118806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:27.119446 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:27.125885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:27.126369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:27.126804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:27.127519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:27.127974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:27.128395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:27.256581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:27.264683 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-07aeeb73-50bb-4722-a0b3-574976c7ea8d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.149666 Aug 06 20:40:27.265257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 190/374] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:27 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:28.285994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:28.286598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:28.293091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:28.293559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:28.293989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:28.294668 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:28.295116 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:28.295561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:28.423205 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:28.430593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-44c3f7be-31af-41e1-9096-91750a0af59c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.148387 Aug 06 20:40:28.431157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 185/375] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:28 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:29.451527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:29.452130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:29.458744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:29.459218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:29.459678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:29.460361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:29.460809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:29.461228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:29.588893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:29.596272 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1a35fb60-3ade-4c7f-a8c4-5bae297ec1b2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.149235 Aug 06 20:40:29.596832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 191/376] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:29 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:30.616526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:30.617147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:30.625851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:30.626706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:30.627300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:30.628025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:30.628494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:30.628926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:30.836416 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:30.844501 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9158c4dd-c616-435d-a3ce-c169f211323d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1508 microversion: 2.1 time: 0.231886 Aug 06 20:40:30.845084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 186/377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:30 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:31.865978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:31.866626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:31.874086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:31.874606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:31.875049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:31.875790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:31.876674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:31.876674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:32.049950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:32.059042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4d6b030f-aa3d-461c-9325-3fa9ca053f67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1514 microversion: 2.1 time: 0.196857 Aug 06 20:40:32.059656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 192/378] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:31 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:40:37.602618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2c537000-7af2-4f1e-bc3c-df2426f5037d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'create', calling method: .version_select at 0x7fba960c2dc0>, body: {"keypair": {"name": "tempest-keypair-1779768967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfXI4lmjSSHRhSOo7pR15i2xKtXG7IRfhkYaxwEKAa6BAGi3fu1Xuq2YXSKg4Ih0aSTt5sv2jmbDVIHJg7T9SRYeETLBZ6TX8I63fohCXby5vGJkbtlxLl34KzeT1vKng=="}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:37.618918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-2c537000-7af2-4f1e-bc3c-df2426f5037d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:40:37.622834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-2c537000-7af2-4f1e-bc3c-df2426f5037d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for user 919c94bd42144c9b86fd9977e85b0762 and project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:40:37.643946 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2c537000-7af2-4f1e-bc3c-df2426f5037d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045208 Aug 06 20:40:37.644524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 187/379] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:40:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:38.842702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-575955728", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3075084b-9df5-48ff-a5de-f7239377ed1b"}], "security_groups": [{"name": "tempest-securitygroup--711383173"}], "key_name": "tempest-keypair-1779768967", "user_data": "}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:38.947404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] validate_networks() for [('3075084b-9df5-48ff-a5de-f7239377ed1b', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:40:39.305183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:40:39.305609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:40:39.306105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:40:39.306630 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:40:39.307047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:40:39.316236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:39.316745 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:39.317181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:39.317905 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:39.318362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:39.318787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:39.335849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:40:39.339790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Getting quotas for user 919c94bd42144c9b86fd9977e85b0762 and project 7e2bf24478c34b9088fb7cfaa0affb97. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:40:39.350672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:40:39.352931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:40:39.399727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-24005c2b-cffc-40d9-9553-f0674fd35de9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.561822 Aug 06 20:40:39.400598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 193/380] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:40:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:40:39.411951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a675167e-c4f8-4769-a14e-d8991c179d84 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:39.412744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a675167e-c4f8-4769-a14e-d8991c179d84 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:39.474928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a675167e-c4f8-4769-a14e-d8991c179d84 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:39.485021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a675167e-c4f8-4769-a14e-d8991c179d84 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1245 microversion: 2.1 time: 0.077737 Aug 06 20:40:39.485580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 188/381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:39 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:40.506206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:40.507432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:40.507618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:40.508125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:40.516544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:40.517418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:40.517584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:40.518083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:40.518465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:40.518633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:40.519314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:40.519778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:40.520205 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:40.520379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:40.521083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:40.522156 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:40.551721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:40.596601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:40.606015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b80fe38b-8b35-4e3d-b55d-60fcd02afe8c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1303 microversion: 2.1 time: 0.103586 Aug 06 20:40:40.606566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 194/382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:40 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:40.655782 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lazy-loading 'services' on Instance uuid 73235c7f-4635-48c9-a4d7-c4634a769ff7 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:40:40.773501 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-156e7cdd-ff5c-47c0-830d-740da3c728c9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "DELETE /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7/os-volume_attachments/a499cb32-a5c5-4fda-aafc-57fe6c1256fe" status: 202 len: 0 microversion: 2.1 time: 0.270941 Aug 06 20:40:40.774177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 189/383] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:40:40 2022] DELETE /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7/os-volume_attachments/a499cb32-a5c5-4fda-aafc-57fe6c1256fe => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:40:41.625861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:41.626566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:41.633562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:41.634120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:41.634618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:41.635414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:41.635867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:41.636289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:41.861349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:41.869296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-690179c0-a747-4de0-821f-3e4ed2421d61 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.247243 Aug 06 20:40:41.870924 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 195/384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:41 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:41.918622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:41.919809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:41.926427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:41.926914 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:41.927378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:41.928070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:41.928524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:41.928943 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:41.955392 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:40:41.989517 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-fb06e16e-9c58-483e-9728-65dbc6bff74a req-e9aecd62-b388-428f-9c3c-0b9b95f60bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671c6efc-e2c0-4075-ab3e-32a56469d1fb", "tag": "9bb66be5-6e4a-435a-bd7c-31d972c43b58"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:42.001797 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-fb06e16e-9c58-483e-9728-65dbc6bff74a req-e9aecd62-b388-428f-9c3c-0b9b95f60bd8 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:42.002432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-fb06e16e-9c58-483e-9728-65dbc6bff74a req-e9aecd62-b388-428f-9c3c-0b9b95f60bd8 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:42.002875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-fb06e16e-9c58-483e-9728-65dbc6bff74a req-e9aecd62-b388-428f-9c3c-0b9b95f60bd8 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:42.014842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-fb06e16e-9c58-483e-9728-65dbc6bff74a req-e9aecd62-b388-428f-9c3c-0b9b95f60bd8 service nova] Creating event network-changed:9bb66be5-6e4a-435a-bd7c-31d972c43b58 for instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb on hv-cinder-85199 Aug 06 20:40:42.019922 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-fb06e16e-9c58-483e-9728-65dbc6bff74a req-e9aecd62-b388-428f-9c3c-0b9b95f60bd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034034 Aug 06 20:40:42.020867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 196/385] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:42.054794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-076c201b-70f6-4984-b896-fb2d168e9315 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "DELETE /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 204 len: 0 microversion: 2.1 time: 0.140544 Aug 06 20:40:42.055407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 190/386] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:40:41 2022] DELETE /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:40:42.064670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:42.065505 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:42.072195 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:42.072852 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:42.073353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:42.074148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:42.074663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:42.075405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:42.206024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:42.213590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-90c5457b-27a3-446d-a0f4-6e5e1a0239cc tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1514 microversion: 2.1 time: 0.153115 Aug 06 20:40:42.214149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 197/387] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:42 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:40:42.313665 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:40:42.313900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:40:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:40:42.892110 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:42.892755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:42.898526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:42.899006 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:42.899480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:42.900162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:42.900611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:42.901032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:43.027034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:43.034949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b49dbb1b-944f-4391-ab9f-1f71ab2dfe2c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.147647 Aug 06 20:40:43.035555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 191/388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:42 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:43.235104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:43.235664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:43.242504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:43.242983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:43.243451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:43.244141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:43.244588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:43.245007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:43.371305 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:43.379303 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3a2ef716-b6c9-4279-b7ee-262538abbcb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1514 microversion: 2.1 time: 0.148595 Aug 06 20:40:43.379859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 198/389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:43 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:44.055220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:44.055847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:44.062805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:44.063307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:44.063744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:44.064424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:44.064875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:44.065294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:44.190199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:44.197536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c2e74d36-9b36-4367-b1e6-c869527b4d67 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.146153 Aug 06 20:40:44.198089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 192/390] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:44 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:44.399962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:44.400491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:44.407373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:44.407851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:44.408280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:44.408960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:44.409406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:44.409824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:44.538655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:44.546634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-265860aa-b1a9-41cf-84fb-651cd4e5bf4e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1514 microversion: 2.1 time: 0.150543 Aug 06 20:40:44.547192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 199/391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:44 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:45.217911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:45.218505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:45.220901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:45.226075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:45.226554 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:45.226982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:45.227689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:45.228137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:45.228554 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:45.356945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:45.364231 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8ce80ac8-19cb-4730-98d2-0256863035a6 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.150188 Aug 06 20:40:45.364794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 193/392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:45 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:45.566609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:45.567218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:45.573691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:45.574175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:45.574610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:45.575320 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:45.575774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:45.576197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:45.701056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:45.708832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-99114a3e-8bd5-4146-9320-77cf3b2ae180 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1514 microversion: 2.1 time: 0.146071 Aug 06 20:40:45.709394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 200/393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:45 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:46.385708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:46.386309 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:46.392648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:46.393137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:46.393568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:46.394252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:46.394697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:46.395115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:46.525835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:46.533726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-135a6b98-abe3-40fe-9c0f-aa1d6c1d4ec3 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.151754 Aug 06 20:40:46.534314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 194/394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:46 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:46.729265 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:46.729885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:46.737057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:46.737547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:46.737993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:46.738684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:46.739142 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:46.739599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:46.864603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:46.872066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bfb0a71e-b307-4685-89f0-dfdc664df208 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1514 microversion: 2.1 time: 0.146720 Aug 06 20:40:46.872638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 201/395] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:46 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:47.554712 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:47.555571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:47.562501 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:47.563019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:47.563510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:47.564211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:47.564669 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:47.565095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:47.893189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:47.893827 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:47.900179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:47.900664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:47.901104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:47.901791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:47.902246 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:47.902666 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:48.029174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:48.037263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-119bb87a-e1bb-4d81-a976-7e7eba4901a3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 200 len: 1472 microversion: 2.1 time: 0.147388 Aug 06 20:40:48.050712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 202/396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:47 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 1472 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:40:48.088310 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-fb5ece7d-0426-4c96-a69b-e51e5058076d req-513f1ce3-6115-4125-9c74-3dc6607f351b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73235c7f-4635-48c9-a4d7-c4634a769ff7", "name": "network-vif-deleted", "tag": "3f80acae-1409-41a8-b7be-2313a53ea5bc"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:48.099835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-fb5ece7d-0426-4c96-a69b-e51e5058076d req-513f1ce3-6115-4125-9c74-3dc6607f351b service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:48.100451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-fb5ece7d-0426-4c96-a69b-e51e5058076d req-513f1ce3-6115-4125-9c74-3dc6607f351b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:48.100737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-fb5ece7d-0426-4c96-a69b-e51e5058076d req-513f1ce3-6115-4125-9c74-3dc6607f351b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:48.110755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:48.113646 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-fb5ece7d-0426-4c96-a69b-e51e5058076d req-513f1ce3-6115-4125-9c74-3dc6607f351b service nova] Creating event network-vif-deleted:3f80acae-1409-41a8-b7be-2313a53ea5bc for instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 on hv-cinder-85199 Aug 06 20:40:48.119385 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b0ac469f-cf56-435f-b2c3-83b310673f2d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.568515 Aug 06 20:40:48.119646 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-fb5ece7d-0426-4c96-a69b-e51e5058076d req-513f1ce3-6115-4125-9c74-3dc6607f351b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036380 Aug 06 20:40:48.120374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 195/397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:47 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:48.121013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 203/398] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:49.057911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:49.058629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: 73235c7f-4635-48c9-a4d7-c4634a769ff7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:49.065456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:49.065940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:49.066385 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:49.067109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:49.067594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:49.068016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:49.082253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] HTTP exception thrown: Instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 could not be found. Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Request method failure captured: Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 HTTP/1.1 Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tFzizBXcNqw6eQ--wDydWAE_vfNHCH4WQ-swjRwsbU-8RuYEZ4AcLvgMmw1tCrOCZgUtEWr-zGrrYpRKokox8ZLn77tyooTGXhZPELtAAuyXFDEcn6noFTJA7NGsQA-_1vZ-7wRQwZHF_YFWupw2ejb60DdCY3rXp2Lry1EMxKy0KY Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: f2b62ba61aeb459eade55243a8187505 Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesSnapshotTestJSON-30187860 Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:40:49.083934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2b62ba61aeb459eade55243a8187505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2b62ba61aeb459eade55243a8187505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2b62ba61aeb459eade55243a8187505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2b62ba61aeb459eade55243a8187505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesSnapshotTestJSON-30187860 Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: f2b62ba61aeb459eade55243a8187505 Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-30187860 Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesSnapshotTestJSON-30187860-project Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 0b1c65231a70438fb722d0e544735526 Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesSnapshotTestJSON-30187860-project Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 could not be found. Aug 06 20:40:49.085987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '73235c7f-4635-48c9-a4d7-c4634a769ff7'} Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 could not be found. Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:40:49.086807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 could not be found. Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 could not be found. Aug 06 20:40:49.088047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:40:49.089157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Returning 404 to user: Instance 73235c7f-4635-48c9-a4d7-c4634a769ff7 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:40:49.089157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fc90bb57-0411-4cd3-a072-7cb94e1cb81f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7" status: 404 len: 111 microversion: 2.1 time: 0.031277 Aug 06 20:40:49.089157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 196/399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:49 2022] GET /compute/v2.1/servers/73235c7f-4635-48c9-a4d7-c4634a769ff7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:40:49.141985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:49.142687 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:49.148766 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:49.150570 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:49.151061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:49.151566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:49.152317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:49.152823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:49.153487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:49.159208 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:49.299594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:49.307173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-77707dff-f6fe-43c7-8429-b8e26ba96227 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.170124 Aug 06 20:40:49.307764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 204/400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:49 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:50.327958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:50.328597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:50.330516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:50.336304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:50.336790 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:50.337225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:50.337914 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:50.338369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:50.338791 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:50.466954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:50.474355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f02036de-63a3-4447-9859-95e93c0fe0fe tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.150240 Aug 06 20:40:50.474915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 197/401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:50 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:51.495126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:51.495774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:51.498223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:51.498991 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:51.505174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:51.505661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:51.506096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:51.506784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:51.507285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:51.507714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:51.636383 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:51.643826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b9c8c858-9f7a-474b-bfe0-49ac9863a977 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.152534 Aug 06 20:40:51.644374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 205/402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:51 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:52.664369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:52.664983 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:52.671422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:52.671909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:52.672349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:52.673038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:52.673495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:52.673920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:52.798369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:52.805635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0fb8f550-ba30-43c7-8449-3e524118f7e1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.145123 Aug 06 20:40:52.806185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 198/403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:52 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:53.826431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:53.827029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:53.833592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:53.834541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:53.835298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:53.836104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:53.836784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:53.837502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:53.954405 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-83f60c35-7404-49b3-aa1b-56cdce2eaabc req-92772d77-779f-4d3c-a172-5d49924d9688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671c6efc-e2c0-4075-ab3e-32a56469d1fb", "name": "network-vif-plugged", "status": "completed", "tag": "9bb66be5-6e4a-435a-bd7c-31d972c43b58"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:53.965261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-83f60c35-7404-49b3-aa1b-56cdce2eaabc req-92772d77-779f-4d3c-a172-5d49924d9688 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:53.966303 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-83f60c35-7404-49b3-aa1b-56cdce2eaabc req-92772d77-779f-4d3c-a172-5d49924d9688 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:53.966820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-83f60c35-7404-49b3-aa1b-56cdce2eaabc req-92772d77-779f-4d3c-a172-5d49924d9688 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:53.978655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:53.986003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2621ae7b-7c3f-44f4-b72c-d3a6fe77a4ad tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.163977 Aug 06 20:40:53.986589 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 206/404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:53 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:53.988850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-83f60c35-7404-49b3-aa1b-56cdce2eaabc req-92772d77-779f-4d3c-a172-5d49924d9688 service nova] Creating event network-vif-plugged:9bb66be5-6e4a-435a-bd7c-31d972c43b58 for instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb on hv-cinder-85199 Aug 06 20:40:53.994014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-83f60c35-7404-49b3-aa1b-56cdce2eaabc req-92772d77-779f-4d3c-a172-5d49924d9688 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044411 Aug 06 20:40:53.994605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 199/405] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:55.006541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:55.007153 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:55.014223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:55.014710 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:55.015147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:55.015860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:55.016319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:55.016744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:55.144859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:55.152194 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e86e09bd-e177-4009-ba4b-faf50158b193 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.149630 Aug 06 20:40:55.152752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 207/406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:55 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:56.173935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:56.174634 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:56.180798 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:56.181281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:56.181719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:56.182416 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:56.182870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:56.183317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:56.313950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:56.321183 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f87ecdc3-c4ce-4b28-9471-05d1a912ff51 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1370 microversion: 2.1 time: 0.151973 Aug 06 20:40:56.321741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 200/407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:56 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:57.342704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:57.343332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:57.349794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:57.350279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:57.350715 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:57.351432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:57.351887 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:57.352328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:57.477189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:40:57.484784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2f1c15f1-837a-4a19-91f6-ebae5581dad1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1563 microversion: 2.1 time: 0.146531 Aug 06 20:40:57.485366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 208/408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:40:57 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:40:57.504736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:40:57.505229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:40:57.511587 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:57.512066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:57.513025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:57.513704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:57.514155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:57.514579 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:57.593430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-18f0c7e1-fe45-4ad1-9648-5c0461c6f304 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092462 Aug 06 20:40:57.594046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 201/409] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:40:57 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:40:58.506587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-e0d00384-b390-4af6-810e-922910c1efd2 req-254bdf22-27e5-4bb3-b177-18adcdffc257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671c6efc-e2c0-4075-ab3e-32a56469d1fb", "tag": "9bb66be5-6e4a-435a-bd7c-31d972c43b58"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:40:58.516946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e0d00384-b390-4af6-810e-922910c1efd2 req-254bdf22-27e5-4bb3-b177-18adcdffc257 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:40:58.517450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e0d00384-b390-4af6-810e-922910c1efd2 req-254bdf22-27e5-4bb3-b177-18adcdffc257 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:40:58.517884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e0d00384-b390-4af6-810e-922910c1efd2 req-254bdf22-27e5-4bb3-b177-18adcdffc257 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:40:58.528544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-e0d00384-b390-4af6-810e-922910c1efd2 req-254bdf22-27e5-4bb3-b177-18adcdffc257 service nova] Creating event network-changed:9bb66be5-6e4a-435a-bd7c-31d972c43b58 for instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb on hv-cinder-85199 Aug 06 20:40:58.533576 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-e0d00384-b390-4af6-810e-922910c1efd2 req-254bdf22-27e5-4bb3-b177-18adcdffc257 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Aug 06 20:40:58.534454 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 209/410] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:01.032493 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1799869265", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "networks": [{"uuid": "544b3ff7-a7cd-4e20-8ac7-20760c8ec275"}]}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:01.083720 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] validate_networks() for [('544b3ff7-a7cd-4e20-8ac7-20760c8ec275', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:41:01.416794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:41:01.417217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:41:01.417704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:41:01.418103 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:41:01.419022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:41:01.427557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:01.428039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:01.428470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:01.429185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:01.429635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:01.430057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:01.446764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Getting quotas for project f2b62ba61aeb459eade55243a8187505. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:41:01.450579 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Getting quotas for user 0b1c65231a70438fb722d0e544735526 and project f2b62ba61aeb459eade55243a8187505. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:41:01.461515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:41:01.463720 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:41:01.508179 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dfe9d808-2210-4e01-9755-5c233e12b842 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480156 Aug 06 20:41:01.508820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 202/411] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:41:01.520672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-07558bb9-0e6c-435d-b897-5d026a95cb56 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:01.521479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-07558bb9-0e6c-435d-b897-5d026a95cb56 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:01.579545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-07558bb9-0e6c-435d-b897-5d026a95cb56 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:01.586609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-07558bb9-0e6c-435d-b897-5d026a95cb56 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1219 microversion: 2.1 time: 0.070737 Aug 06 20:41:01.587355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 210/412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:01 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:02.608524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:02.609136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:02.615861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:02.616573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:02.617012 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:02.617708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:02.618165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:02.618594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:02.691066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:02.698542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d8c7a7f7-11ad-4434-a2c6-2f53d47807c2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1279 microversion: 2.1 time: 0.094852 Aug 06 20:41:02.699105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 203/413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:02 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:03.720763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:03.722203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:03.729790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:03.730185 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:03.730622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:03.731345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:03.731852 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:03.732275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:03.944507 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:03.952714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3459e79a-ca1b-4ab9-978b-d6742642ef20 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.235903 Aug 06 20:41:03.953278 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 211/414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:03 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:04.079432 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-8bf74fc3-d8a2-44c9-94ba-e46dd94851e8 req-f7e617fa-d8b8-4dcd-8fcd-25517153b546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe3977b-6510-4d3b-bbc8-0ae18a364c82", "tag": "80f63110-8554-48a1-b406-239987173c5c"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:04.089802 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-8bf74fc3-d8a2-44c9-94ba-e46dd94851e8 req-f7e617fa-d8b8-4dcd-8fcd-25517153b546 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:04.090399 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-8bf74fc3-d8a2-44c9-94ba-e46dd94851e8 req-f7e617fa-d8b8-4dcd-8fcd-25517153b546 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:04.090917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-8bf74fc3-d8a2-44c9-94ba-e46dd94851e8 req-f7e617fa-d8b8-4dcd-8fcd-25517153b546 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:04.101809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-8bf74fc3-d8a2-44c9-94ba-e46dd94851e8 req-f7e617fa-d8b8-4dcd-8fcd-25517153b546 service nova] Creating event network-changed:80f63110-8554-48a1-b406-239987173c5c for instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 on hv-cinder-85199 Aug 06 20:41:04.107174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-8bf74fc3-d8a2-44c9-94ba-e46dd94851e8 req-f7e617fa-d8b8-4dcd-8fcd-25517153b546 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032073 Aug 06 20:41:04.107805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 204/415] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:04.973479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:04.974127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:04.980705 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:04.981252 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:04.981718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:04.982409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:04.982865 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:04.983328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:05.107606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:05.114853 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7bd478d6-9b91-49c0-a345-7dd2a8d93fb3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.145196 Aug 06 20:41:05.115441 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 212/416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:04 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:06.135350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:06.136038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:06.142686 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:06.143163 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:06.143635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:06.144314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:06.144764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:06.145185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:06.274293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:06.281911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d5c9b200-acec-434e-8f9e-bed99d283cab tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.151164 Aug 06 20:41:06.282465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 205/417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:06 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:07.302177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:07.302782 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:07.309983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:07.310467 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:07.310926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:07.311648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:07.312102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:07.312527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:07.473825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:07.481515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a7d4ce21-e719-4e69-841c-38b5325a0c33 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.183178 Aug 06 20:41:07.482097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 213/418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:07 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:07.641380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:07.641901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:07.648196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:07.648684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:07.649120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:07.649815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:07.650267 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:07.650699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:07.664179 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:07.675106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7f2741d0-a800-45da-a600-6f3df8b58079 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/ips" status: 200 len: 148 microversion: 2.1 time: 0.038220 Aug 06 20:41:07.675704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 206/419] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:41:07 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:08.502725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:08.503350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:08.509622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:08.510099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:08.510526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:08.511205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:08.511681 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:08.512744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:08.641386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:08.648460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2397939a-edf3-4196-ad69-649c9bdae33e tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.149866 Aug 06 20:41:08.649024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:08 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:09.045879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e115c9dd-045d-4e35-bd4d-91c3239e3e81"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:09.048290 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:09.054655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:09.055143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:09.055615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:09.056303 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:09.056758 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:09.057182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:09.338217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-456615ea-5f97-437c-91bc-c27c00a36e0b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296431 Aug 06 20:41:09.338824 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 207/421] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:41:09 2022] POST /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:09.669234 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:09.669845 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:09.676319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:09.676841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:09.677279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:09.677973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:09.678425 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:09.678850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:09.803650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:09.811029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3609ff82-2f39-43d5-b0bd-fd6c1fb36f98 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.146131 Aug 06 20:41:09.811618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 215/422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:09 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:10.832721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:10.833418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:10.839478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:10.840000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:10.840437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:10.841129 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:10.841612 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:10.842036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:10.970607 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:10.977830 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-23c5f4dc-6798-453a-a1c0-f422e87f45e9 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.149980 Aug 06 20:41:10.978394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 208/423] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:10 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:11.973253 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-7f471576-acae-4fd6-83b2-337bcc41c2b1 req-0d8ad897-41b4-45a4-b7ab-31a8750436c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe3977b-6510-4d3b-bbc8-0ae18a364c82", "name": "network-vif-plugged", "status": "completed", "tag": "80f63110-8554-48a1-b406-239987173c5c"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:11.979801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:11.984933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-7f471576-acae-4fd6-83b2-337bcc41c2b1 req-0d8ad897-41b4-45a4-b7ab-31a8750436c8 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:11.985411 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-7f471576-acae-4fd6-83b2-337bcc41c2b1 req-0d8ad897-41b4-45a4-b7ab-31a8750436c8 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:11.985840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-7f471576-acae-4fd6-83b2-337bcc41c2b1 req-0d8ad897-41b4-45a4-b7ab-31a8750436c8 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:11.997155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-7f471576-acae-4fd6-83b2-337bcc41c2b1 req-0d8ad897-41b4-45a4-b7ab-31a8750436c8 service nova] Creating event network-vif-plugged:80f63110-8554-48a1-b406-239987173c5c for instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 on hv-cinder-85199 Aug 06 20:41:11.999118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:11.999867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:12.002187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-7f471576-acae-4fd6-83b2-337bcc41c2b1 req-0d8ad897-41b4-45a4-b7ab-31a8750436c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Aug 06 20:41:12.002912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 216/424] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:12.003685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:12.004341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:12.008510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:12.009017 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:12.009458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:12.010185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:12.010628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:12.011057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:12.144615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:12.153440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-be48eb7b-e640-4414-bfd7-fce8e8e68018 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.158253 Aug 06 20:41:12.154007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 209/425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:11 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:13.174566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:13.175264 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:13.181294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:13.181768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:13.182195 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:13.182869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:13.183353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:13.183774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:13.308721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:13.316013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-41a269e4-e260-4c73-9a45-a7876f376595 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.146096 Aug 06 20:41:13.316569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 217/426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:13 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:14.337117 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:14.337728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:14.344173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:14.344657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:14.345096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:14.345790 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:14.346243 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:14.346666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:14.473859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:14.481785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3e09efd8-1834-4c7d-8b53-d73ed45419ae tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1319 microversion: 2.1 time: 0.148592 Aug 06 20:41:14.482350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 210/427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:14 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:15.502010 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:15.502613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:15.509123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:15.509611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:15.510045 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:15.510734 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:15.511183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:15.511632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:15.639964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:15.647428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8ef0255f-02b7-4fa6-b212-0342b4362a15 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1508 microversion: 2.1 time: 0.149269 Aug 06 20:41:15.647993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 218/428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:15 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:15.667346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9f6ab11-ea4f-4bab-a87d-8f77afcce61f", "device": "/dev/sdb"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:15.670246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:15.672550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:15.677685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:15.678170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:15.678605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:15.679315 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:15.679774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:15.680197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:16.187811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ddc3ef68-9856-49de-93c9-903401bb09b2 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "POST /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524137 Aug 06 20:41:16.188410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 211/429] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:41:15 2022] POST /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:16.862759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ee2d735f-ae9b-47df-9380-894f0f45a5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: .version_select at 0x7fba958d6040>, body: {"keypair": {"name": "tempest-keypair-1214462809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9Yv3Wlid8vJXx15l3+Z15SCiIsidlE8aWS28YYZyauIhYR6kQrasKMW4MUKN4juJNCstvaiUjC16c8VuQPfl7h/6WiUVP+lJb2GC1+CcWV8trUsEcPFbD+xhnXi3UmtQ=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:16.878515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-ee2d735f-ae9b-47df-9380-894f0f45a5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:41:16.882345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-ee2d735f-ae9b-47df-9380-894f0f45a5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:41:16.907671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ee2d735f-ae9b-47df-9380-894f0f45a5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048739 Aug 06 20:41:16.908256 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 219/430] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:41:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:18.067044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1392827955", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "204900d1-dea4-474e-a19d-da292c4d4d6a"}], "security_groups": [{"name": "tempest-securitygroup--135219195"}], "key_name": "tempest-keypair-1214462809", "user_data": "}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:18.175266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] validate_networks() for [('204900d1-dea4-474e-a19d-da292c4d4d6a', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:41:18.534693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:41:18.535148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:41:18.535661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:41:18.536071 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:41:18.536483 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:41:18.545669 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:18.546172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:18.546609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:18.547364 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:18.547822 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:18.548248 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:18.565220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:41:18.569175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:41:18.580199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:41:18.582818 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:41:18.627207 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8d2a2726-129d-486b-833d-9226c5b83ec7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565303 Aug 06 20:41:18.627878 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 212/431] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:41:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:41:18.638898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ced3a2ee-1f2f-43d8-b528-248566622424 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:18.639538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ced3a2ee-1f2f-43d8-b528-248566622424 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:18.698867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ced3a2ee-1f2f-43d8-b528-248566622424 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:18.705773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ced3a2ee-1f2f-43d8-b528-248566622424 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1242 microversion: 2.1 time: 0.070714 Aug 06 20:41:18.706340 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 220/432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:18 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:19.726815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:19.727374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:19.734232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:19.734716 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:19.735186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:19.735901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:19.736547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:19.736975 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:19.841199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:19.850476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-90cea839-2a42-4b1d-9879-57c8858e4561 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1302 microversion: 2.1 time: 0.127849 Aug 06 20:41:19.851385 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 213/433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:19 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:20.875497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:20.879994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:20.882869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:20.889626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:20.890338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:20.891078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:20.891828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:20.892293 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:20.892727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:20.898903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=76 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:21.114820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:21.122610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b9f8cedd-3b56-4db2-8934-63a302d862c7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.251251 Aug 06 20:41:21.123286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 221/434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:20 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:21.253833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-b3e2ba18-5d44-4967-a5de-dd2101d581d0 req-99f1f9c5-7885-4da4-9d86-f7f0d189271a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70795577-6b17-4729-9500-c1f804c6e525", "tag": "e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:21.264428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-b3e2ba18-5d44-4967-a5de-dd2101d581d0 req-99f1f9c5-7885-4da4-9d86-f7f0d189271a service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:21.265043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-b3e2ba18-5d44-4967-a5de-dd2101d581d0 req-99f1f9c5-7885-4da4-9d86-f7f0d189271a service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:21.265606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-b3e2ba18-5d44-4967-a5de-dd2101d581d0 req-99f1f9c5-7885-4da4-9d86-f7f0d189271a service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:21.278374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-b3e2ba18-5d44-4967-a5de-dd2101d581d0 req-99f1f9c5-7885-4da4-9d86-f7f0d189271a service nova] Creating event network-changed:e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69 for instance 70795577-6b17-4729-9500-c1f804c6e525 on hv-cinder-85199 Aug 06 20:41:21.283083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-b3e2ba18-5d44-4967-a5de-dd2101d581d0 req-99f1f9c5-7885-4da4-9d86-f7f0d189271a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033083 Aug 06 20:41:21.283714 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 214/435] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:22.142923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:22.143557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:22.149917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:22.150394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:22.150822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:22.151527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:22.151988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:22.152404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:22.281388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:22.288641 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-df216927-4d6d-4216-92c5-6be3f46db5e6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.149600 Aug 06 20:41:22.289204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 222/436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:22 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:23.310300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:23.310995 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:23.317003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:23.317487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:23.317921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:23.318607 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:23.319057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:23.319506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:23.444052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:23.451332 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3602ad65-c2aa-426e-8e6a-d7fb56a587be tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.145717 Aug 06 20:41:23.451890 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 215/437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:23 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:24.471629 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:24.472235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:24.478199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:24.478732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:24.479201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:24.479914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:24.480865 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:24.481319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:24.613904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:24.621840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ac711b44-fedb-4af9-8cb4-1be0aece3b2e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.153660 Aug 06 20:41:24.622404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 223/438] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:24 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:25.642490 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:25.643100 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:25.649441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:25.649926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:25.650363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:25.651055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:25.651538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:25.651968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:25.777503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:25.784835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6de6d58b-22dd-46ce-913c-b48db27d76e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.146176 Aug 06 20:41:25.785388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 216/439] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:25 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:26.289033 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:26.289523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:26.296435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:26.296919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:26.297352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:26.298049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:26.298504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:26.298930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:26.321157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8b697ee3-8258-4f2e-88b8-232f02d722d1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/ips" status: 200 len: 145 microversion: 2.1 time: 0.036091 Aug 06 20:41:26.321707 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 224/440] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:41:26 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:26.805116 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:26.806281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:26.819590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:26.819590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:26.819590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:26.819590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:26.819955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:26.819955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:27.232426 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:27.247995 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e311e143-5e10-4e7e-845b-ef90a33dfe2d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.446495 Aug 06 20:41:27.260628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 217/441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:26 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:28.273882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:28.274417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:28.280816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:28.281299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:28.281737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:28.282425 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:28.282879 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:28.283336 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:28.412776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:28.420896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1f3e6346-4dcf-4265-90ee-b03837a4362d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.150889 Aug 06 20:41:28.421461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 225/442] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:28 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:29.441823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:29.442467 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:29.444860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:29.445694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:29.452625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:29.453112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:29.453542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:29.454228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:29.454673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:29.455122 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:29.584820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:29.592213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2e4c517e-c72d-4df9-a7f3-e3c16e3f0ccd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.154332 Aug 06 20:41:29.592774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 218/443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:29 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:30.612880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:30.614037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:30.615952 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:30.623537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:30.624030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:30.624470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:30.625175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:30.625637 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:30.626062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:30.751296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:30.758779 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a8101307-c9ff-4dcf-86fb-d7d14cf377a7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.150029 Aug 06 20:41:30.759357 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 226/444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:30 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:31.779408 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:31.780020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:31.786327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:31.786809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:31.787270 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:31.787964 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:31.788423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:31.788845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:31.921740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:31.929174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-84e50b0e-5518-4d2a-8cc3-47d4abd05f1c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.153714 Aug 06 20:41:31.929734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 219/445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:31 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:32.361634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-abf8ad27-873b-42e0-88ea-412017a63501 req-0f7723b1-66de-4e57-a241-bece86cf26b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70795577-6b17-4729-9500-c1f804c6e525", "name": "network-vif-plugged", "status": "completed", "tag": "e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:32.372370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-abf8ad27-873b-42e0-88ea-412017a63501 req-0f7723b1-66de-4e57-a241-bece86cf26b3 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:32.373264 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-abf8ad27-873b-42e0-88ea-412017a63501 req-0f7723b1-66de-4e57-a241-bece86cf26b3 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:32.373777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-abf8ad27-873b-42e0-88ea-412017a63501 req-0f7723b1-66de-4e57-a241-bece86cf26b3 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:32.385200 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-abf8ad27-873b-42e0-88ea-412017a63501 req-0f7723b1-66de-4e57-a241-bece86cf26b3 service nova] Creating event network-vif-plugged:e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69 for instance 70795577-6b17-4729-9500-c1f804c6e525 on hv-cinder-85199 Aug 06 20:41:32.390669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-abf8ad27-873b-42e0-88ea-412017a63501 req-0f7723b1-66de-4e57-a241-bece86cf26b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032780 Aug 06 20:41:32.391517 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 227/446] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:41:32.950056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:32.950719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:32.957422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:32.957905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:32.958366 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:32.959052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:32.959536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:32.959958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:33.096410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:33.104841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-451812fa-0ca5-43b9-8800-a40ac329d769 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.159735 Aug 06 20:41:33.105949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 220/447] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:32 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:33.694345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84944145-08e5-48ca-95f6-f5a34329cf92"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:33.696770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:33.702838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:33.703370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:33.703816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:33.704507 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:33.704970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:33.705402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:34.126377 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:34.127090 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:34.133335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:34.133817 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:34.134249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:34.134951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:34.135427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:34.135847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:34.268922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:34.276769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-58a14f04-ce76-41eb-97e8-9ecf941881e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.154271 Aug 06 20:41:34.287310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 221/448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:34 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:34.324866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eb1d55de-5daa-4723-aea8-28db5b9a8bee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635039 Aug 06 20:41:34.325520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 228/449] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:41:33 2022] POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:35.298458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:35.299065 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:35.305480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:35.305967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:35.306402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:35.307099 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:35.307581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:35.308007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:35.312420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:35.438341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:35.445803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ebe58c74-2356-4136-abe1-1be549e0376e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.151230 Aug 06 20:41:35.446355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 222/450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:35 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:36.467113 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:36.467919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:36.473984 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:36.474466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:36.474899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:36.475612 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:36.476065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:36.476488 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:36.614729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:36.622810 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a83b4031-abe0-4a90-ac7a-9b52a023fecb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.160572 Aug 06 20:41:36.623394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 229/451] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:36 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:37.643287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:37.643941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:37.650340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:37.650829 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:37.651288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:37.652600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:37.653061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:37.653488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:37.776330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:37.784229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c25a542b-3902-49b7-be17-505deed1b908 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.144870 Aug 06 20:41:37.784789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 223/452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:37 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:38.804771 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:38.805310 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:38.812124 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:38.812603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:38.813034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:38.813713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:38.814161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:38.814583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:38.941885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:38.949933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2017e1d7-5d25-4f4d-b088-778633537c4e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.149008 Aug 06 20:41:38.950480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 230/453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:38 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:39.971676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:39.972261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:39.978287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:39.978772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:39.979286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:39.980023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:39.980505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:39.980929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:40.112806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:40.120223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-02edfcb8-d1da-4138-947e-6db0661092f7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1367 microversion: 2.1 time: 0.153187 Aug 06 20:41:40.121274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 224/454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:39 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:41.139874 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:41.140486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:41.146854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:41.147365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:41.147800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:41.148482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:41.148933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:41.149358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:41.274451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:41.282487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1f128ba4-98c6-470e-beef-31afdf998feb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1555 microversion: 2.1 time: 0.146425 Aug 06 20:41:41.283049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 231/455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:41 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:41.302393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:41.302918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:41.309226 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:41.309709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:41.310142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:41.310823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:41.311304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:41.311729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:41.387787 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-254fecfb-870b-4edb-939a-d678ddb454fb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088619 Aug 06 20:41:41.388506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 225/456] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:41:41 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:42.314081 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-0ae5021e-638b-4aec-8f50-9b3defe88058 req-a20c1eed-e850-4127-b29b-bcdc3dfb56ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70795577-6b17-4729-9500-c1f804c6e525", "tag": "e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:42.324130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0ae5021e-638b-4aec-8f50-9b3defe88058 req-a20c1eed-e850-4127-b29b-bcdc3dfb56ac service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:42.324610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0ae5021e-638b-4aec-8f50-9b3defe88058 req-a20c1eed-e850-4127-b29b-bcdc3dfb56ac service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:42.325571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0ae5021e-638b-4aec-8f50-9b3defe88058 req-a20c1eed-e850-4127-b29b-bcdc3dfb56ac service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:42.338077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-0ae5021e-638b-4aec-8f50-9b3defe88058 req-a20c1eed-e850-4127-b29b-bcdc3dfb56ac service nova] Creating event network-changed:e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69 for instance 70795577-6b17-4729-9500-c1f804c6e525 on hv-cinder-85199 Aug 06 20:41:42.344177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-0ae5021e-638b-4aec-8f50-9b3defe88058 req-a20c1eed-e850-4127-b29b-bcdc3dfb56ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033724 Aug 06 20:41:42.344823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 232/457] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:41:42.843730 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:42.844919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:42.863716 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:42.864215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:42.865009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:42.865348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:42.865801 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:42.866225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:42.948091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lazy-loading 'services' on Instance uuid cfe3977b-6510-4d3b-bbc8-0ae18a364c82 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:41:43.025586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-105c4dee-f09c-4819-91ef-36c4bc6a0d0f tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82/os-volume_attachments/c9f6ab11-ea4f-4bab-a87d-8f77afcce61f" status: 202 len: 0 microversion: 2.1 time: 0.186038 Aug 06 20:41:43.026180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 226/458] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:41:42 2022] DELETE /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82/os-volume_attachments/c9f6ab11-ea4f-4bab-a87d-8f77afcce61f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:41:47.138141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-57d0983f-e42b-4896-ac64-925079ac35be tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:47.144186 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57d0983f-e42b-4896-ac64-925079ac35be tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:47.144667 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57d0983f-e42b-4896-ac64-925079ac35be tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:47.145096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57d0983f-e42b-4896-ac64-925079ac35be tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:47.204235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-57d0983f-e42b-4896-ac64-925079ac35be tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Going to try to stop instance {{(pid=129475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 20:41:47.245607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-57d0983f-e42b-4896-ac64-925079ac35be tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action" status: 202 len: 0 microversion: 2.1 time: 0.112015 Aug 06 20:41:47.246204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 233/459] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:41:47 2022] POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:41:47.255535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:47.256306 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:47.258239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:47.265195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:47.265873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:47.266410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:47.267182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:47.267735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:47.268224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:47.400253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:47.408238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6539ff1b-767b-4ea3-b423-861054af8a36 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.157619 Aug 06 20:41:47.408788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 227/460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:47 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:48.370923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:48.371573 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:48.377761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:48.378218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:48.378633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:48.379351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:48.379807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:48.380228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:48.407696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Going to try to terminate instance {{(pid=129475) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:41:48.429019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:48.429626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:48.435860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:48.436356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:48.436796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:48.437493 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:48.438137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:48.438564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:48.497795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-057a3758-ca0b-40b0-a124-1c1e66beb292 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 204 len: 0 microversion: 2.1 time: 0.131232 Aug 06 20:41:48.498389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 234/461] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:41:48 2022] DELETE /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:41:48.506706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:48.507447 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:48.513335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:48.513818 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:48.514251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:48.514943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:48.515427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:48.515856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:48.531138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:48.618797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:48.626926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-51d8a394-4ed0-4767-895b-7bc5c3f20cc4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.201596 Aug 06 20:41:48.627596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 228/462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:48 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:48.662110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:48.670035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b0ec861a-50da-45c3-bbb6-01b01c938fb8 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1514 microversion: 2.1 time: 0.167407 Aug 06 20:41:48.670604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 235/463] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:48 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:49.647984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:49.648591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:49.655588 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:49.656073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:49.656507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:49.657191 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:49.657646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:49.658072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:49.690841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:49.691502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:49.698094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:49.698586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:49.699022 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:49.700257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:49.700717 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:49.701145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:49.834007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:49.842043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-92fcc543-e963-453c-8115-2fe5e5194ca2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.197900 Aug 06 20:41:49.842613 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 229/464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:49 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:49.862009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:49.869349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-961534ec-acdc-40c1-9c5d-4983b595d525 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1514 microversion: 2.1 time: 0.182275 Aug 06 20:41:49.869910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 236/465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:49 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:41:50.863533 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:50.864122 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:50.870552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:50.871035 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:50.871509 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:50.872203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:50.872658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:50.873085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:50.889871 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:50.890505 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:50.896596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:50.897078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:50.897513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:50.898365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:50.898822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:50.899257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:51.176390 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:51.184131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4ef9ba16-4209-4e49-ac0e-3db4e63de55f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.324483 Aug 06 20:41:51.184690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 230/466] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:50 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:51.189022 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b1c65231a70438fb722d0e544735526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2b62ba61aeb459eade55243a8187505', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:51.196685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b12eb3b6-e40f-4a37-ab42-dcf210c41961 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 200 len: 1514 microversion: 2.1 time: 0.310578 Aug 06 20:41:51.197247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 237/467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:50 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 1514 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:51.460351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-006f7283-a592-4b58-b1a9-841c37bde8f2 req-76522bf7-4b0e-43ac-996f-82db556720f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe3977b-6510-4d3b-bbc8-0ae18a364c82", "name": "network-vif-deleted", "tag": "80f63110-8554-48a1-b406-239987173c5c"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:41:51.469748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-006f7283-a592-4b58-b1a9-841c37bde8f2 req-76522bf7-4b0e-43ac-996f-82db556720f6 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:51.470224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-006f7283-a592-4b58-b1a9-841c37bde8f2 req-76522bf7-4b0e-43ac-996f-82db556720f6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:51.470655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-006f7283-a592-4b58-b1a9-841c37bde8f2 req-76522bf7-4b0e-43ac-996f-82db556720f6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:51.481192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-006f7283-a592-4b58-b1a9-841c37bde8f2 req-76522bf7-4b0e-43ac-996f-82db556720f6 service nova] Creating event network-vif-deleted:80f63110-8554-48a1-b406-239987173c5c for instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 on hv-cinder-85199 Aug 06 20:41:51.485973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-006f7283-a592-4b58-b1a9-841c37bde8f2 req-76522bf7-4b0e-43ac-996f-82db556720f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029423 Aug 06 20:41:51.486921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 231/468] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:41:52.205822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:52.206424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:52.208940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:52.214593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:52.215075 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:52.215561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:52.216247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:52.216698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:52.217119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:52.219460 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:52.220336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] [instance: cfe3977b-6510-4d3b-bbc8-0ae18a364c82] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:52.226844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:52.227364 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:52.227806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:52.228539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:52.228999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:52.229421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:52.244222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] HTTP exception thrown: Instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 could not be found. Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Request method failure captured: Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 HTTP/1.1 Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tFzizBXcNqw6eQ--wDydWAE_vfNHCH4WQ-swjRwsbU-8RuYEZ4AcLvgMmw1tCrOCZgUtEWr-zGrrYpRKokox8ZLn77tyooTGXhZPELtAAuyXFDEcn6noFTJA7NGsQA-_1vZ-7wRQwZHF_YFWupw2ejb60DdCY3rXp2Lry1EMxKy0KY Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: f2b62ba61aeb459eade55243a8187505 Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesSnapshotTestJSON-30187860 Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:41:52.245844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f2b62ba61aeb459eade55243a8187505"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2b62ba61aeb459eade55243a8187505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f2b62ba61aeb459eade55243a8187505"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f2b62ba61aeb459eade55243a8187505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesSnapshotTestJSON-30187860 Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: f2b62ba61aeb459eade55243a8187505 Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-30187860 Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesSnapshotTestJSON-30187860-project Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 0b1c65231a70438fb722d0e544735526 Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesSnapshotTestJSON-30187860-project Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 could not be found. Aug 06 20:41:52.247954 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': 'cfe3977b-6510-4d3b-bbc8-0ae18a364c82'} Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 could not be found. Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:41:52.252047 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 could not be found. Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 could not be found. Aug 06 20:41:52.253470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:41:52.254648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] Returning 404 to user: Instance cfe3977b-6510-4d3b-bbc8-0ae18a364c82 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:41:52.254648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2fc2565a-5f1c-4aab-9e7b-98286f2756d3 tempest-VolumesSnapshotTestJSON-30187860 tempest-VolumesSnapshotTestJSON-30187860-project] 10.222.0.17 "GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82" status: 404 len: 111 microversion: 2.1 time: 0.033524 Aug 06 20:41:52.254648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 232/469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:52 2022] GET /compute/v2.1/servers/cfe3977b-6510-4d3b-bbc8-0ae18a364c82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:41:52.356131 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:52.364072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-22402e7e-33b3-43a4-ad4a-f021659d48ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.162023 Aug 06 20:41:52.364640 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 238/470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:52 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:53.385965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:53.386496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:53.393294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:53.393777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:53.394209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:53.394893 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:53.395382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:53.395809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:53.522936 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:53.531484 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0b836db0-aca2-47b7-b56e-4c5dab4ab632 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.149533 Aug 06 20:41:53.532043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 233/471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:53 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:54.552326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:54.552933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:54.559296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:54.559780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:54.560214 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:54.560900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:54.561352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:54.561777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:54.697127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:54.705675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-14a716c1-7233-4fbc-b26a-0b1976235fbc tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.157152 Aug 06 20:41:54.706240 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 239/472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:54 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:55.725918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:55.726561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:55.732964 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:55.733452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:55.733886 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:55.734574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:55.735028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:55.735490 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:55.861127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:55.869016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-58589046-6235-42c3-a8d9-2ec28d432b7c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.146977 Aug 06 20:41:55.869575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 234/473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:55 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:56.890720 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:56.891426 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:56.897802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:56.898292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:56.898731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:56.899451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:56.899911 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:56.900337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:57.029642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:57.037550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1ff8f193-1ab2-4bb5-ac8a-5cf2d98359f2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.151287 Aug 06 20:41:57.038117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 240/474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:56 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:58.058971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:58.059647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:58.066655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:58.067135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:58.067600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:58.068288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:58.068736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:58.069158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:58.194873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:58.202708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7d61cc1f-b817-4e29-ba57-1e3f05395d47 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.147678 Aug 06 20:41:58.203277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 235/475] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:58 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:41:59.224825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:41:59.225433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:41:59.232441 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:59.232921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:59.233351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:59.234035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:41:59.234482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:41:59.234902 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:41:59.361605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:41:59.369451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3b5c5e07-4ca5-4f0e-886c-2a48a5cff165 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.148409 Aug 06 20:41:59.370001 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 241/476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:41:59 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:00.391236 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:00.391931 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:00.402968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:00.403656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:00.404266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:00.405010 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:00.405576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:00.406444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:00.537320 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:00.545428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-68516860-5e65-44d3-a1fb-f24b70d36ecf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.158521 Aug 06 20:42:00.545996 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 236/477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:00 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:01.566971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:01.568216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:01.575596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:01.576152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:01.576618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:01.577395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:01.577887 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:01.578373 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:01.722664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:01.732893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5be6abe8-706d-4918-9635-64b4beb837e2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.169997 Aug 06 20:42:01.733458 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 242/478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:01 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:02.753726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:02.754334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:02.760794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:02.761278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:02.761714 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:02.762979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:02.763461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:02.763888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:02.904244 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:02.920618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e506cf51-1c10-4d0d-a7d6-466c4cce8d52 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.170619 Aug 06 20:42:02.921181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 237/479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:02 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:03.941678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:03.942407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:03.948664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:03.949149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:03.949635 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:03.950320 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:03.950773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:03.951190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:04.075088 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:04.083172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f70ded82-4c39-47e5-b270-2cf6a32d2e5a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.145270 Aug 06 20:42:04.083752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 243/480] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:03 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:05.104321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:05.104928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:05.111457 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:05.111945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:05.112384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:05.113072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:05.113527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:05.113952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:05.243432 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:05.251945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6a9e2c96-1235-4321-a786-a352aae47167 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.151500 Aug 06 20:42:05.252503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 238/481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:05 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:06.272239 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:06.272772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:06.279080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:06.279591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:06.280020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:06.280701 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:06.281151 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:06.281573 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:06.408565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:06.416409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bb24bb0b-2cfd-4cd5-bc4d-5317050cbcee tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.148073 Aug 06 20:42:06.416978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 244/482] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:06 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:07.438743 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:07.439493 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:07.446397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:07.446941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:07.447459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:07.448221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:07.448776 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:07.449909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:07.452881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:07.578814 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:07.587134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0d040eed-4355-47e3-b784-b9da69ebd70b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.152597 Aug 06 20:42:07.587724 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 239/483] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:07 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:08.608066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:08.608678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:08.614965 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:08.615493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:08.615933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:08.616653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:08.617108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:08.617541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:08.745030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:08.753376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c02d1932-101a-4e85-909a-2a030b0df17f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.149107 Aug 06 20:42:08.753951 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 245/484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:08 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:09.774632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:09.775161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:09.782377 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:09.782892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:09.783357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:09.784084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:09.784552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:09.784973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:10.067596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:10.076127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-caeda5f4-c877-4539-bca7-10976156266c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.305735 Aug 06 20:42:10.076689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 240/485] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:09 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:11.097108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:11.097716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:11.104211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:11.104687 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:11.105117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:11.106391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:11.106842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:11.107288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:11.233115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:11.240934 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e187f5fb-f979-44a4-a8c2-a701190e6e48 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.147654 Aug 06 20:42:11.241494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 246/486] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:11 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:12.261990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:12.262598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:12.268616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:12.269097 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:12.269528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:12.270206 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:12.270656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:12.271082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:12.395588 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:12.404417 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9048aea0-fba3-4198-8df5-b9a342804080 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.146338 Aug 06 20:42:12.405023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 241/487] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:12 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:13.429156 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:13.430317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:13.442374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:13.442869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:13.443345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:13.444056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:13.444518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:13.444948 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:13.585156 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:13.594343 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d70cfd19-4c83-434d-a571-2cffec25ffda tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1701 microversion: 2.1 time: 0.170183 Aug 06 20:42:13.594926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 247/488] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:13 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:13.615173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b5c2b92f-5517-452e-b501-d28f1d545d43 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:13.621818 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5c2b92f-5517-452e-b501-d28f1d545d43 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:13.622303 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5c2b92f-5517-452e-b501-d28f1d545d43 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:13.622737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5c2b92f-5517-452e-b501-d28f1d545d43 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:13.682373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b5c2b92f-5517-452e-b501-d28f1d545d43 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Going to try to start instance {{(pid=129476) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 20:42:13.721806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b5c2b92f-5517-452e-b501-d28f1d545d43 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action" status: 202 len: 0 microversion: 2.1 time: 0.110706 Aug 06 20:42:13.722398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 242/489] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:42:13 2022] POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:42:13.731080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:13.731727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:13.737497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:13.737988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:13.738470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:13.739165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:13.739694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:13.740122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:13.871355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:13.879462 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-35cdb1fb-ff5d-430c-9f4a-0bcc46d448d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1710 microversion: 2.1 time: 0.152744 Aug 06 20:42:13.880031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 248/490] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:13 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:14.901228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:14.901899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:14.908494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:14.908986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:14.909425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:14.910142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:14.910603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:14.911031 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:15.041573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:15.049400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f0935dcd-2ab6-4c9a-825d-4906b98a7148 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1710 microversion: 2.1 time: 0.152925 Aug 06 20:42:15.049957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 243/491] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:14 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:16.069983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:16.070601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:16.076976 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:16.077458 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:16.077893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:16.078581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:16.079029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:16.079472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:16.263210 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:16.271205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-dc7d8261-d32d-4a0f-9298-bda2647ff381 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1710 microversion: 2.1 time: 0.205125 Aug 06 20:42:16.271813 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 249/492] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:16 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1710 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:17.113113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:17.113635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:17.120026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:17.120503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:17.120934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:17.121620 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:17.122068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:17.122487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:17.146962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3918df28-dbd9-40d3-a47e-dd9227165cb7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/ips" status: 200 len: 152 microversion: 2.20 time: 0.037741 Aug 06 20:42:17.147538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 244/493] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Aug 6 20:42:17 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:42:17.293859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:17.294713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:17.302337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:17.303056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:17.303623 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:17.304389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:17.305098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:17.305508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:17.442536 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:17.455448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b742518b-fa4f-4073-92ea-0d944a2fffe6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1714 microversion: 2.1 time: 0.162499 Aug 06 20:42:17.455448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 250/494] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:42:17 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:42:19.025986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:19.026524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:19.029584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=36 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:19.035209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:19.035735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:19.036181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:19.036886 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:19.037347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:19.037777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:19.060748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lazy-loading 'flavor' on Instance uuid 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:42:19.241220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-74187313-19c1-46dd-8ed1-0882cd13417e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/action" status: 202 len: 0 microversion: 2.20 time: 0.219078 Aug 06 20:42:19.241870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 245/495] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 20:42:19 2022] POST /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:42:19.250079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:19.250691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:19.260726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:19.260726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:19.260726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:19.260726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:19.261164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:19.261164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:19.265786 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=94 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:19.400452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:19.408909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:19.410451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:19.411636 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c4942f9b-1283-4225-8630-1143ab28b20d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.165383 Aug 06 20:42:19.412221 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 251/496] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:19 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:42:20.436057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:20.436793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:20.443517 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:20.444009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:20.444447 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:20.445142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:20.445597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:20.446023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:20.580247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:20.588870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:20.590366 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:20.591585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c2dbcfca-3450-4bbc-922c-09890c2fafcc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.160942 Aug 06 20:42:20.592143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 246/497] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:20 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:21.613981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:21.614588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:21.621058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:21.621535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:21.621966 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:21.622646 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:21.623093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:21.623542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:21.747650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:21.755605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:21.757226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:21.758532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a862e938-9d6d-4f52-b09b-29c6f588b275 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.148455 Aug 06 20:42:21.759514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 252/498] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:21 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:22.781251 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:22.781855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:22.788284 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:22.788767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:22.789204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:22.789890 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:22.790346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:22.790771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:22.921307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:22.929115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:22.930624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:22.931797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2416ca50-fbb6-437e-889b-d8d1a6dbd95c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.154457 Aug 06 20:42:22.932346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 247/499] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:22 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:23.953963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:23.954568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:23.956639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=30 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:23.962147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:23.962626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:23.963057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:23.963767 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:23.964217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:23.964638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:24.088329 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:24.096548 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:24.098037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:24.099174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d46b2969-51b6-474e-b56d-0db13ecdb1e0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.149052 Aug 06 20:42:24.099757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 253/500] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:23 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:25.122628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:25.123347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:25.129859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:25.130421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:25.130855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:25.131581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:25.132028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:25.132448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:25.341958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:25.349850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:25.351412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:25.352575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7e5b1f2e-34ca-4648-938c-cd3dd78ed647 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.234503 Aug 06 20:42:25.353134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 248/501] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:25 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:26.375903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:26.376503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:26.383123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:26.383633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:26.384061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:26.384850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:26.385304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:26.385723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:26.516226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:26.524007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:26.525499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:26.526641 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7fb16407-7bea-4c9f-962e-6fe551a58b2f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.155121 Aug 06 20:42:26.527196 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 254/502] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:26 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:27.548855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:27.549485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:27.556763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:27.557287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:27.557761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:27.558530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:27.559028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:27.559552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:27.690645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:27.698360 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:27.699887 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:27.701658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fdb3be30-59b1-481a-9056-d388dcc9285b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.156711 Aug 06 20:42:27.702209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 249/503] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:27 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:28.723585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:28.724190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:28.730883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:28.731423 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:28.731868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:28.732569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:28.733059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:28.733525 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:28.870533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:28.879067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:28.880842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:28.882208 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d82df4b5-d3a9-4908-afeb-209ba74ffec7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.162511 Aug 06 20:42:28.882942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 255/504] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:28 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:29.905880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:29.906485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:29.912892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:29.913375 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:29.913811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:29.914499 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:29.914950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:29.915410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:30.041601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:30.050027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:30.051586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:30.052729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c1edf4fc-9a1e-4711-b8e0-04d24d435ef8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.150776 Aug 06 20:42:30.053291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 250/505] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:29 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:31.075606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:31.076220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:31.082841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:31.083363 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:31.083800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:31.084489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:31.084953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:31.085376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:31.213003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:31.221420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:31.222919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:31.224102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d4eda3ac-5ad6-43e3-94d0-59200e61f512 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.152908 Aug 06 20:42:31.224669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 256/506] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:31 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:32.246083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:32.246717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:32.253222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:32.253704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:32.254138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:32.254833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:32.255316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:32.255744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:32.380396 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:32.388377 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:32.389889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:32.391042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-016002dc-2576-46e6-99f7-098bb2ec25ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.148779 Aug 06 20:42:32.391635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 251/507] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:32 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:33.414357 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:33.414959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:33.421414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:33.421892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:33.422328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:33.423011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:33.423487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:33.423910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:33.550071 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:33.558141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:33.559768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:33.560913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4412882c-1d12-49a6-9288-231fbc469914 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.150431 Aug 06 20:42:33.561466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 257/508] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:33 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:34.583149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:34.583781 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:34.590106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:34.591113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:34.591584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:34.592273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:34.592726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:34.593150 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:34.724983 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:34.733403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:34.734903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:34.736096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e4c75baf-bdb9-4339-a877-0984e958fa78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.157077 Aug 06 20:42:34.736661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 252/509] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:34 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:35.758418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:35.759019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:35.765756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:35.766270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:35.766703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:35.767458 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:35.767923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:35.768348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:35.900440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:35.908332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:35.909846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:35.911002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-625dd760-ba11-4d31-b51b-4c3741e8d33f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.156504 Aug 06 20:42:35.911605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 258/510] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:35 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:36.933927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:36.934965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:36.941455 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:36.941939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:36.942369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:36.943046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:36.943524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:36.943944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:36.946512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:37.073232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:37.080986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:37.082488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:37.083919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-15089040-6f67-45cc-ba24-da5b233d9070 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1744 microversion: 2.20 time: 0.153941 Aug 06 20:42:37.084478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 253/511] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:36 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:38.107723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:38.108346 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:38.114698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:38.115184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:38.115651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:38.116342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:38.116800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:38.117227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:38.249271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:38.257190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:38.258696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:38.259914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4f3a2dc8-a9ee-4db0-bf6c-76a67cccd2a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1744 microversion: 2.20 time: 0.156754 Aug 06 20:42:38.260468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 259/512] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:38 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:39.283581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:39.284183 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:39.290551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:39.291029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:39.291503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:39.292186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:39.292632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:39.293048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:39.419351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:39.427293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:39.428741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:39.429894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2abe7797-56f8-4188-aa00-f318dfb0d99f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1744 microversion: 2.20 time: 0.150152 Aug 06 20:42:39.430432 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 254/513] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:39 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:40.235883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-4544d27b-2800-40c5-bfe2-b33b75d9e361 req-09544880-28e0-444d-ada4-c2a64c05b224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "name": "network-vif-plugged", "status": "completed", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:40.246284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-4544d27b-2800-40c5-bfe2-b33b75d9e361 req-09544880-28e0-444d-ada4-c2a64c05b224 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:40.247506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-4544d27b-2800-40c5-bfe2-b33b75d9e361 req-09544880-28e0-444d-ada4-c2a64c05b224 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:40.248012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-4544d27b-2800-40c5-bfe2-b33b75d9e361 req-09544880-28e0-444d-ada4-c2a64c05b224 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:40.260189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-4544d27b-2800-40c5-bfe2-b33b75d9e361 req-09544880-28e0-444d-ada4-c2a64c05b224 service nova] Creating event network-vif-plugged:b73fc326-7095-42f3-9b6f-f9cae7cc05ce for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 on hv-cinder-85199 Aug 06 20:42:40.265748 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-4544d27b-2800-40c5-bfe2-b33b75d9e361 req-09544880-28e0-444d-ada4-c2a64c05b224 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033583 Aug 06 20:42:40.266560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 260/514] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:42:40.452519 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:40.453077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:40.459806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:40.460288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:40.460718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:40.461400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:40.461848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:40.462266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:40.589132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:40.597513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:40.599009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:40.600193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-45acb676-57cf-4619-b212-600346a7a273 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1744 microversion: 2.20 time: 0.152227 Aug 06 20:42:40.600750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 255/515] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:40 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:41.622988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:41.623739 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:41.630612 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:41.631097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:41.631582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:41.632278 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:41.632737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:41.633166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:41.760632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:41.769284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:41.770805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:41.772002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eb36bd85-7a19-4f6a-80ec-e99f4b931aef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1744 microversion: 2.20 time: 0.153828 Aug 06 20:42:41.772557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 261/516] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:41 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:42.794500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:42.795098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:42.800957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:42.801440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:42.801867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:42.802547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:42.802999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:42.803450 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:42.936081 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:42.943812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:42.945302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:42.946438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-18e2a4a0-8121-4d54-9f93-65e23b9a9456 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1744 microversion: 2.20 time: 0.155965 Aug 06 20:42:42.946997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 256/517] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:42 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:43.970597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:43.971217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:43.978887 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:43.979420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:43.979862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:43.980661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:43.981145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:43.981594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:44.120877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:44.130244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:44.132209 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:44.133695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fc0f5097-e1ac-4646-915e-0cdffca9705e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.167437 Aug 06 20:42:44.134249 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 262/518] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:43 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:45.156704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:45.158134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:45.164455 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:45.165201 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:45.165855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:45.166764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:45.167373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:45.167916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:45.307186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:45.315991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:45.317916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:45.319337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ac2167b7-0ddd-46a8-988d-e2d9abaf39b5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.166681 Aug 06 20:42:45.320089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 257/519] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:45 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:46.343544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:46.344917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:46.351807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:46.352376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:46.352900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:46.353695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:46.354154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:46.354578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:46.492521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:46.501539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:46.503140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:46.504319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7a5cd7d5-76e1-431f-b0fd-468c526615b4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.165500 Aug 06 20:42:46.519270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 263/520] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:46 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:47.528842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:47.529471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:47.536998 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:47.537346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:47.537780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:47.538640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:47.539091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:47.539539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:47.681693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:47.690828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:47.692660 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:47.694059 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-92df4b4f-e6d1-4035-9248-2ffa32d9de5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.169339 Aug 06 20:42:47.697298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 258/521] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:47 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:48.721063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:48.721662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:48.727955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:48.728443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:48.728880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:48.729578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:48.730034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:48.730460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:48.875814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:48.886597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:48.888772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:48.889943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-abade8f1-0e59-417b-a617-e4ca11fee4a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.176249 Aug 06 20:42:48.903270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 264/522] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:48 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:49.916428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:49.917028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:49.919734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=28 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:49.926697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:49.927187 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:49.927646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:49.928364 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:49.928819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:49.929239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:50.076455 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:50.086123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:50.087870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:50.089909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e7d3b28c-885e-4f83-b405-3807271c8cd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.177976 Aug 06 20:42:50.090542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 259/523] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:49 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:51.113115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:51.114013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:51.119842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:51.120380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:51.120814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:51.121584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:51.122151 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:51.122692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:51.125365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=80 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:51.274203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:51.284236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:51.287450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:51.289220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-39a0b824-6879-4bf8-a806-1a126b963c1f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.179916 Aug 06 20:42:51.305221 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 265/524] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:51 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:52.325754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:52.326390 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:52.333683 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:52.334165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:52.334599 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:52.335323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:52.335772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:52.336193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:52.488184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:52.496082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:52.498169 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:52.499363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e8a9cd39-2711-47e7-b564-c585343aa9ac tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.190505 Aug 06 20:42:52.507285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 260/525] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:52 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:53.523977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:53.525036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:53.531982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:53.532477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:53.532917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:53.533909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:53.534684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:53.535414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:53.669145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:53.677025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:53.678508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:53.679679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a4dab7a8-0b9d-4316-9d3f-2c31bd7eb349 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1739 microversion: 2.20 time: 0.160687 Aug 06 20:42:53.680235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 266/526] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:53 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:42:54.703406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:54.704003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:54.710529 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:54.711013 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:54.711478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:54.712177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:54.712636 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:54.713060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:54.914979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:54.922784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:54.924315 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:54.925480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9bd90d0b-15ea-4fd3-9971-2b9840e05eef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1721 microversion: 2.20 time: 0.226426 Aug 06 20:42:54.926039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 261/527] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:54 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:55.949219 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:55.949829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:55.952180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=28 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:55.957359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:55.958093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:55.958523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:55.959201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:55.959675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:55.960091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:56.088300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:56.096727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:56.098234 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:56.099434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d90a2d8e-a5a2-4aea-8819-fe69bf26ec1c tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1721 microversion: 2.20 time: 0.154270 Aug 06 20:42:56.099993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 267/528] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:55 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:57.123115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:57.123733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:57.130010 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.130495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.130933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.131666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.132126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.132553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.266246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:57.274085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:57.275618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:57.276780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e2a10b57-5286-4b9a-ba04-78b17536c905 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1724 microversion: 2.20 time: 0.158420 Aug 06 20:42:57.277341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 262/529] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:57 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:42:57.298755 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42da4cf5-c41f-4643-94e4-f28fa90b7c84"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:57.301082 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:57.307511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.307995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.308431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.309118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.309576 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.310628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.580381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-058b7599-f4c8-48c1-9e54-01b589e66990 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286015 Aug 06 20:42:57.581135 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 268/530] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Aug 6 20:42:57 2022] POST /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:42:57.698999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:57.699616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:57.706022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.706500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.706933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.707639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.708344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.708763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.792874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129476) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 20:42:57.857014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9e5f114a-0818-406a-b68f-d1c9f759ead8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/action" status: 202 len: 0 microversion: 2.20 time: 0.161909 Aug 06 20:42:57.857589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 263/531] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 20:42:57 2022] POST /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:42:57.865792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:57.866405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:57.873310 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.873804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.874243 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:57.874942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:57.875433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:57.875866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:58.005169 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:58.013838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:58.015484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:58.016651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-80054351-90bc-4f0f-81c4-677bbe4f1ee2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1750 microversion: 2.20 time: 0.154785 Aug 06 20:42:58.017206 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 269/532] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:57 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:42:58.278000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-687fb489-47eb-41ee-b9ec-18df4ee7cdb6 req-fd5ef5b2-bbab-4bc5-9ca1-118a1458756e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "name": "network-vif-unplugged", "status": "completed", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:58.287822 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-687fb489-47eb-41ee-b9ec-18df4ee7cdb6 req-fd5ef5b2-bbab-4bc5-9ca1-118a1458756e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:58.288296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-687fb489-47eb-41ee-b9ec-18df4ee7cdb6 req-fd5ef5b2-bbab-4bc5-9ca1-118a1458756e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:58.288719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-687fb489-47eb-41ee-b9ec-18df4ee7cdb6 req-fd5ef5b2-bbab-4bc5-9ca1-118a1458756e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:58.300086 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.compute.server_external_events [req-687fb489-47eb-41ee-b9ec-18df4ee7cdb6 req-fd5ef5b2-bbab-4bc5-9ca1-118a1458756e service nova] Unable to find a host for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4. Dropping event network-vif-unplugged {{(pid=129476) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 20:42:58.300960 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-687fb489-47eb-41ee-b9ec-18df4ee7cdb6 req-fd5ef5b2-bbab-4bc5-9ca1-118a1458756e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.098829 Aug 06 20:42:58.301531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 264/533] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 100 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 20:42:58.411893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e41ea9-0353-4cbb-b7e9-e095e9e30e17"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:42:58.414247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:58.420682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:58.421401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:58.421929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:58.422703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:58.423236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:58.423757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:58.709882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d556da57-37f9-4554-a09a-3cbd73f45b41 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411918 Aug 06 20:42:58.710576 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 270/534] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:42:58 2022] POST /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:42:59.040113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:42:59.040655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:42:59.047653 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:59.048331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:59.048639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:59.049339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:42:59.049858 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:42:59.050285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:42:59.182528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:59.191404 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:59.192918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:42:59.194140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0fa36369-9cf6-41a8-b147-9b037c18c63d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.158670 Aug 06 20:42:59.194693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 265/535] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:42:59 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:00.220965 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:00.221663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:00.228273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:00.228761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:00.229207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:00.229901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:00.230359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:00.230789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:00.356013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:00.364840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:00.366344 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:00.367508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e00043f6-8cd4-417f-b0af-73a69011c469 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.150802 Aug 06 20:43:00.368066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 271/536] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:00 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:01.391632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:01.392233 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:01.398542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:01.399022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:01.399491 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:01.400167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:01.400621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:01.401039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:01.523746 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:01.532398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:01.533891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:01.535040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bcfa2890-6876-4bf3-85da-7e420808a6f7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.147864 Aug 06 20:43:01.535696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 266/537] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:01 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:02.557817 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:02.558341 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:02.565208 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:02.565688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:02.566121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:02.566796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:02.567264 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:02.567688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:02.696010 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:02.704849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:02.706460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:02.707678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5abaf22d-60fb-40f9-bf2e-23f0b6c3e0c0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.153756 Aug 06 20:43:02.708501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 272/538] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:02 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:03.730119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:03.730731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:03.737619 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:03.738104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:03.738538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:03.739223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:03.739699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:03.740132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:03.867714 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:03.877363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:03.878872 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:03.880045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9804321e-6d06-49e8-99cb-580b9ccc52c9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.153856 Aug 06 20:43:03.880594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 267/539] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:03 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:04.902663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:04.903187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:04.910130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:04.910614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:04.911053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:04.911786 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:04.912247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:04.912703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:05.041591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:05.050403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:05.052001 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:05.053193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-603709bb-4be5-4083-b879-cbfa445efc61 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.154626 Aug 06 20:43:05.053756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 273/540] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:04 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:06.075675 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:06.076280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:06.082489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:06.083212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:06.083675 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:06.084357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:06.084807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:06.085268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:06.219053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:06.227478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:06.229014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:06.230169 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f6db2af0-f2fd-48d4-bdd4-3f7b144534ce tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1752 microversion: 2.20 time: 0.158410 Aug 06 20:43:06.230714 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 268/541] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:06 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:06.234705 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:06.236984 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:06.243102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:06.243610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:06.244111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:06.245593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:06.246062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:06.246490 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:06.271220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lazy-loading 'flavor' on Instance uuid 671c6efc-e2c0-4075-ab3e-32a56469d1fb {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:06.395085 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8fb20c1b-ca6b-403c-999f-deef181df266 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/action" status: 200 len: 32 microversion: 2.1 time: 0.164674 Aug 06 20:43:06.399988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 274/542] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:43:06 2022] POST /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:43:06.404888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:06.406026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:06.411888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:06.412363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:06.412801 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:06.413477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:06.413926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:06.414347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:06.432089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:06.630681 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:06.639229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3bc092d3-5b06-468a-84d4-b62e9c1b8063 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.238031 Aug 06 20:43:06.640327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 269/543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:06 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:07.254530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:07.255279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:07.261322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:07.261816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:07.262259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:07.262961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:07.263532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:07.263964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:07.660587 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:07.661197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:07.667654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:07.668147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:07.668590 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:07.669287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:07.669755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:07.670182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:07.826618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:07.828949 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:07.836601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:07.838093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:07.839331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b95d9ff1-3b25-44c2-bfed-21fe9cf6870e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.589451 Aug 06 20:43:07.840205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 275/544] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:07 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:07.949436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:07.958452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6e2c86d0-42d2-451d-8c89-c42d0dfbccdb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.301442 Aug 06 20:43:07.959023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 270/545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:07 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:08.863382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:08.864269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:08.873353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:08.874901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:08.875742 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:08.877019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:08.878587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:08.879528 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:08.980602 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:08.981370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:08.988989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:08.989480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:08.990123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:08.990840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:08.991407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:08.991872 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:09.031595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:09.041096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:09.042664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:09.044358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e7ec85ad-54b4-419e-99e4-68c6357ca1d8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.186314 Aug 06 20:43:09.045130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 276/546] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:08 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:09.134623 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:09.142402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d6346292-f02a-4dce-91c8-8d26f41648f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.166263 Aug 06 20:43:09.142962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 271/547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:08 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:10.068351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:10.068978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:10.075656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:10.076144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:10.076595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:10.078057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:10.078510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:10.078933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:10.163165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:10.163811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:10.170370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:10.170855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:10.171316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:10.172020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:10.172477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:10.172901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:10.220493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:10.229621 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:10.231412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:10.232877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5de36b87-572d-412b-8bb3-5259f4e54cec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.168377 Aug 06 20:43:10.233611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 277/548] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:10 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:10.318315 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:10.326620 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5b6d5687-f308-4520-9731-ba400ff759a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.167091 Aug 06 20:43:10.327273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 272/549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:10 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:11.255309 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:11.256040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:11.262531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:11.263058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:11.263566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:11.264891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:11.265325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:11.265773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:11.351016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:11.352562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:11.363545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:11.364549 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:11.365361 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:11.366466 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:11.367312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:11.368637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:11.410776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:11.422054 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:11.431131 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:11.432504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ae19690e-2d02-4403-a5c3-edc57caeaf83 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.181090 Aug 06 20:43:11.433591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 278/550] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:11 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:11.522484 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:11.531349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2e46d5d5-2c1e-4515-ba8d-b1b9cc664a93 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.185801 Aug 06 20:43:11.532248 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 273/551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:11 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:12.350703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:12.351279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:12.357510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.357990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.358420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.359126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.359596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.360016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.386675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-62775a64-074b-4358-934f-2f6f7f9f3a06 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/ips" status: 200 len: 148 microversion: 2.1 time: 0.157218 Aug 06 20:43:12.387231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 279/552] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:43:12 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/ips => generated 148 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:12.399088 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e115c9dd-045d-4e35-bd4d-91c3239e3e81"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:12.401630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:12.408307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.408785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.409213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.409906 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.410352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.410768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.455960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:12.456590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:12.463029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.463483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.463964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.464647 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.465099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.465518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.497639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Invalid volume: volume e115c9dd-045d-4e35-bd4d-91c3239e3e81 is already attached to instances: 46acb22e-5b82-4d53-adae-81e616c05c32 Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: POST /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/os-volume_attachments HTTP/1.1 Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 74 Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:43:12.499922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {"volumeAttachment": {"volumeId": "e115c9dd-045d-4e35-bd4d-91c3239e3e81"}} Aug 06 20:43:12.501363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Invalid volume: volume e115c9dd-045d-4e35-bd4d-91c3239e3e81 is already attached to instances: 46acb22e-5b82-4d53-adae-81e616c05c32 Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'server_id': '70795577-6b17-4729-9500-c1f804c6e525', 'body': {'volumeAttachment': {'volumeId': 'e115c9dd-045d-4e35-bd4d-91c3239e3e81'}}} Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e115c9dd-045d-4e35-bd4d-91c3239e3e81 is already attached to instances: 46acb22e-5b82-4d53-adae-81e616c05c32 Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:43:12.502125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e115c9dd-045d-4e35-bd4d-91c3239e3e81 is already attached to instances: 46acb22e-5b82-4d53-adae-81e616c05c32 Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:12.503412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e115c9dd-045d-4e35-bd4d-91c3239e3e81 is already attached to instances: 46acb22e-5b82-4d53-adae-81e616c05c32 Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 400 to user: Invalid volume: volume e115c9dd-045d-4e35-bd4d-91c3239e3e81 is already attached to instances: 46acb22e-5b82-4d53-adae-81e616c05c32 {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5553f2f7-c9a1-4779-bc2a-3c58c8c17549 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106403 Aug 06 20:43:12.504593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 274/553] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:43:12 2022] POST /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:43:12.510064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:12.512084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:12.517641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.518141 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.518575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.519293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.519746 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.520171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.549454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:43:12.621800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:12.638998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:12.641237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:12.644702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-288e18fb-d4ae-44f9-9811-29d2ccf304a3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.192810 Aug 06 20:43:12.645280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 280/554] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:12 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:12.658399 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:12.659294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:12.662769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2fac85d1-1bed-4551-b75d-b673a0b2e721 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 204 len: 0 microversion: 2.1 time: 0.156234 Aug 06 20:43:12.663396 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 275/555] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:43:12 2022] DELETE /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:43:12.672631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:12.673058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.673483 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:12.673722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.674279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.675052 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.675771 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.676822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.679682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.680169 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.680608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.681304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:12.681762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:12.682520 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:12.876423 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:12.880327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:12.884897 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0cb2e584-4051-4b7f-96b5-3bda8db1842e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.238538 Aug 06 20:43:12.889514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 281/556] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:12 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:12.889699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0199f1ff-3d9b-4d09-9c5f-9be84adc4f46 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.220304 Aug 06 20:43:12.889699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 276/557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:12 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:13.668283 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:13.668892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:13.675367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:13.675856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:13.676288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:13.676980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:13.677431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:13.677849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:13.820643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:13.830081 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:13.831621 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:13.832803 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d516db14-c835-410e-a089-9490180555a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.168563 Aug 06 20:43:13.833643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 282/558] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:13 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:13.907182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:13.907807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:13.910422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:13.911287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:13.914468 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:13.914796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:13.915228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:13.915958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:13.916409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:13.918961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:13.919744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:13.920246 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:13.921062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:13.921584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:13.922117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:13.930039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:14.124743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:14.132591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5fcdb517-fbb4-40b4-b791-ba9c5c30dc1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.227480 Aug 06 20:43:14.133342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 283/559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:13 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:14.136488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:14.147655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-aec8e2fb-cf27-4bb8-981b-b9d239695d38 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.244746 Aug 06 20:43:14.148448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 277/560] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:13 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:14.856388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:14.857231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:14.864258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:14.864743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:14.865175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:14.865869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:14.866323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:14.866746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.007282 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:15.015762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:15.017247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:15.018397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-552b082a-26ea-42ab-89a2-86e233258969 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.165894 Aug 06 20:43:15.018957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 284/561] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:14 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:15.154364 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:15.155037 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:15.162481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.162967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.163430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.164215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.164668 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.165091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.169027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:15.169648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:15.176384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.176949 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.177455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.178236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:15.178763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:15.179284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:15.371742 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:15.376351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:15.379879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0013ac75-55c4-4653-a8cb-8d0bb9962506 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.229693 Aug 06 20:43:15.380540 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 278/562] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:15 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:15.385318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e120d2fd-680b-4a78-94cf-1c597c81a82b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.219239 Aug 06 20:43:15.385318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 285/563] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:15 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:16.042054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:16.043138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:16.049883 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:16.050450 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:16.051069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:16.051867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:16.052357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:16.052780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:16.184378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:16.195051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:16.196635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:16.197786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-543b71bf-ddab-4cc5-ab00-700c4a26bd7d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.159742 Aug 06 20:43:16.198371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 279/564] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:16 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:16.404215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:16.404894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:16.406905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:16.407584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:16.412465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:16.412957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:16.413385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:16.413627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:16.414086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:16.414195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:16.414538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:16.414646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:16.414959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:16.415235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:16.415723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:16.416148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:16.633063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:16.635685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:16.641093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-de4e3201-c341-4c36-8877-aa86ece9ee4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.240867 Aug 06 20:43:16.641671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 286/565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:16 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:16.643953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2970fb7f-904f-4096-b2c0-aba11140cab1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.240946 Aug 06 20:43:16.644512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 280/566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:16 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:17.221221 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:17.221828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:17.227737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:17.228222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:17.228651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:17.229336 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:17.234236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:17.234704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:17.380101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:17.390920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:17.392565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:17.393835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-91dddc61-514b-4850-b0cf-5810540673e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.176490 Aug 06 20:43:17.394506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 287/567] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:17 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:17.662637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:17.663282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:17.664802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:17.665420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:17.670052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:17.670601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:17.671097 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:17.671785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:17.671915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:17.672273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:17.672571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:17.672710 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:17.673114 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:17.673411 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:17.673866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:17.674293 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:17.871176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:17.874856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:17.879710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a7f319ba-8219-42f5-8b88-861f42f131e4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.221552 Aug 06 20:43:17.886754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0d3d78ad-c7bb-404d-9890-3cbc451c45e9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.225459 Aug 06 20:43:17.893672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 288/568] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:17 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:17.893906 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 281/569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:17 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:18.417365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:18.417982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:18.424652 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:18.425141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:18.425580 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:18.426287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:18.426748 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:18.427180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:18.555610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:18.564518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:18.566046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:18.567278 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fb40bbcc-a52d-4e78-90e3-4ded4b002625 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.153992 Aug 06 20:43:18.567836 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 289/570] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:18 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:18.902087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:18.902952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:18.908527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:18.909140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:18.910843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:18.911369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:18.911809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:18.912767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:18.913231 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:18.913728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:18.915555 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:18.916050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:18.916483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:18.917178 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:18.917630 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:18.918053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:19.109840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:19.113865 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:19.117274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fb083fee-4334-4647-a3cf-b9e6343c6fd9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.219058 Aug 06 20:43:19.117839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 282/571] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:18 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:19.121829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-12f3c4d0-a45a-408a-86df-dd93742747f0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.217687 Aug 06 20:43:19.122382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 290/572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:18 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:19.589920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:19.590525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:19.596566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:19.597051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:19.597487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:19.598180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:19.598629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:19.599049 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:19.724586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:19.733663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:19.735156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:19.736331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7e65e166-921d-4d95-b391-75ac1a7b6aa3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.150276 Aug 06 20:43:19.736890 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 283/573] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:19 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:20.138515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:20.139660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:20.144744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:20.145349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:20.146060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:20.146541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:20.146972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:20.147684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:20.147832 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:20.148459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:20.148594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:20.153016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:20.153504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:20.153934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:20.154625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:20.155718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:20.156140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:20.171187 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:20.344661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:20.347552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:20.352138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1338b45e-0633-4f26-b119-e85331f613a3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.217408 Aug 06 20:43:20.352695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 291/574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:20 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:20.356589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4de3203d-d861-42a0-8b3c-6d777f9f20de tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.214619 Aug 06 20:43:20.356589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 284/575] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:20 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:20.759606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:20.760202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:20.766769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:20.767268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:20.767696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:20.768370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:20.768819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:20.769239 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:20.896805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:20.898941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:20.906377 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:20.907908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:20.909051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-708d7610-fb34-44d0-8db3-d50e69d40d20 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.153286 Aug 06 20:43:20.909596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 292/576] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:20 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:21.372992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:21.373725 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:21.377810 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:21.378423 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:21.380642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:21.381391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:21.381596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:21.382245 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:21.382720 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:21.383137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:21.385317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:21.386078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:21.386604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:21.387494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:21.387954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:21.388386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:21.587918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:21.590698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:21.597146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a28d1d90-bc8a-497a-8ff7-46ccc3c8dff3 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.227877 Aug 06 20:43:21.600918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0e6d0fc8-21bd-47dd-a07c-dd640bab3be9 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.228100 Aug 06 20:43:21.601669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 293/577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:21 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:21.605193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 285/578] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:21 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:21.933883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:21.934503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:21.941101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:21.941594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:21.942093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:21.943381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:21.943381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:21.943672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:22.071578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:22.080587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:22.082108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:22.083560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-261f9b57-256f-4fdf-a3bf-fae144f49e33 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.154797 Aug 06 20:43:22.084117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 294/579] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:21 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:22.617862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:22.618476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:22.621772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:22.622375 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:22.625077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:22.625568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:22.626001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:22.626688 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:22.627285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:22.627741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:22.628701 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:22.629184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:22.629616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:22.630302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:22.630752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:22.631171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:22.817605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:22.820769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:22.825172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-cb41744d-ca4a-4bbb-9e48-f2b44e92be33 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.211122 Aug 06 20:43:22.825815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 286/580] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:22 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:22.829284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-95080ece-b827-44b7-af28-5c584e2b4312 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.211276 Aug 06 20:43:22.829834 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 295/581] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:22 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:23.106982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:23.107622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:23.114192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:23.114673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:23.115102 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:23.115820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:23.116271 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:23.116693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:23.246666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:23.255135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:23.256674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:23.257834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a19e3d6e-ac0c-483c-bd07-9eb3d7dda9cd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.154827 Aug 06 20:43:23.258544 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 287/582] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:23 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:23.847619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:23.848254 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:23.849685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:23.850293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:23.854598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:23.855077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:23.855538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:23.856220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:23.856608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:23.856736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:23.857072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:23.857176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:23.857506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:23.858765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:23.859214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:23.859658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:24.050244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:24.053492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:24.057985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9a0dba1d-6d2b-495f-b621-74326aeabf51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.214317 Aug 06 20:43:24.058584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 296/583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:23 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:24.061710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-caf73703-7a7f-4544-b15e-8ffb4b14e4ed tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.215887 Aug 06 20:43:24.062271 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 288/584] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:23 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:24.280188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:24.280716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:24.287507 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:24.287995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:24.288433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:24.289126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:24.289584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:24.290015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:24.413992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:24.414626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:24.421509 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:24.422044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:24.422530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:24.423317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:24.423604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:24.423840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:24.424351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:24.432808 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:24.434331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:24.435600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-89a3af0e-8ac0-483e-9533-e541c8fa6828 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.159339 Aug 06 20:43:24.436742 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 297/585] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:24 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:24.505794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lazy-loading 'services' on Instance uuid 72752a0b-3b0b-428e-b578-4958b8a51a1b {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:24.577236 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7a3e4d24-4e86-416d-85c6-c8d35363219a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-volume_attachments/84944145-08e5-48ca-95f6-f5a34329cf92" status: 202 len: 0 microversion: 2.1 time: 0.268940 Aug 06 20:43:24.577821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 289/586] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:43:24 2022] DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-volume_attachments/84944145-08e5-48ca-95f6-f5a34329cf92 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:43:25.079134 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:25.079881 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:25.082845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:25.084572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:25.087753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:25.088448 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:25.088883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:25.090497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:25.091191 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:25.091421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:25.091915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:25.092554 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:25.092853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:25.093566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:25.094170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:25.094606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:25.324601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:25.327821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:25.332299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e2b7ee35-4f45-4acf-9a09-077f8fed156b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1680 microversion: 2.1 time: 0.256986 Aug 06 20:43:25.332920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 298/587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:25 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1680 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:25.336081 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5310fe7a-8c9f-44e5-8206-c11e771f8565 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.257960 Aug 06 20:43:25.336645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 290/588] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:25 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:25.458743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:25.459380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:25.465315 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:25.465803 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:25.466238 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:25.466947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:25.468002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:25.468428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:25.603592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:25.612216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:25.613707 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:25.614853 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6a292ad2-45b2-4a2f-83a2-0b368b6304fd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.160206 Aug 06 20:43:25.615432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 299/589] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:25 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:26.353965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:26.354585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:26.362291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:26.363749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:26.363884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:26.364664 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:26.365306 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:26.366494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:26.367184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:26.367941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:26.369676 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=66 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:26.377139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:26.378072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:26.378932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:26.380246 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:26.381102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:26.381830 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:26.507641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:26.515543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f73f11e6-42d1-45e0-baab-44b7615f1b51 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1613 microversion: 2.1 time: 0.165509 Aug 06 20:43:26.516144 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 291/590] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:26 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1613 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:26.637837 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:26.638445 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:26.645757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:26.646256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:26.646700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:26.647446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:26.647900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:26.648327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:26.943653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:26.952155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ad3cf59c-616f-431e-9294-9b9dccf07271 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.597362 Aug 06 20:43:26.952987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 300/591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:26 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:27.008980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:27.018018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:27.019548 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:27.020698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b9916f13-36fc-4037-8cdf-d89ffd40f099 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.386926 Aug 06 20:43:27.021456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 292/592] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:26 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:27.192563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-0457b263-4e1e-4490-9fd2-c90a41bfb039 req-cf5aa046-81c0-435c-b1b1-5e7fc6af643a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70795577-6b17-4729-9500-c1f804c6e525", "name": "network-vif-deleted", "tag": "e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:27.204162 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0457b263-4e1e-4490-9fd2-c90a41bfb039 req-cf5aa046-81c0-435c-b1b1-5e7fc6af643a service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.205026 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0457b263-4e1e-4490-9fd2-c90a41bfb039 req-cf5aa046-81c0-435c-b1b1-5e7fc6af643a service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.205693 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0457b263-4e1e-4490-9fd2-c90a41bfb039 req-cf5aa046-81c0-435c-b1b1-5e7fc6af643a service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.219698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-0457b263-4e1e-4490-9fd2-c90a41bfb039 req-cf5aa046-81c0-435c-b1b1-5e7fc6af643a service nova] Creating event network-vif-deleted:e92b9e5d-5cf4-4f37-b566-fbf42a2f7b69 for instance 70795577-6b17-4729-9500-c1f804c6e525 on hv-cinder-85199 Aug 06 20:43:27.226771 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-0457b263-4e1e-4490-9fd2-c90a41bfb039 req-cf5aa046-81c0-435c-b1b1-5e7fc6af643a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095562 Aug 06 20:43:27.227746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 301/593] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:27.537877 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:27.539598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:27.548944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.549521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.550829 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.552117 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.553260 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.554041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.599056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.599811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.600409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.601026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'fault' on Instance uuid 70795577-6b17-4729-9500-c1f804c6e525 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:27.648113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:27.656341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e092c692-d14a-4eb3-a70a-79ab052d469c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1332 microversion: 2.1 time: 0.123208 Aug 06 20:43:27.656846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 293/594] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:27 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:27.825644 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-25590655-5201-44fd-aa37-f38138cb7bb9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:27.836529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-25590655-5201-44fd-aa37-f38138cb7bb9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.837021 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-25590655-5201-44fd-aa37-f38138cb7bb9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.837456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-25590655-5201-44fd-aa37-f38138cb7bb9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.859982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-25590655-5201-44fd-aa37-f38138cb7bb9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Going to try to stop instance {{(pid=129475) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 20:43:27.903892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-25590655-5201-44fd-aa37-f38138cb7bb9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action" status: 202 len: 0 microversion: 2.1 time: 0.083611 Aug 06 20:43:27.904941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 302/595] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:43:27 2022] POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:43:27.913133 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:27.914081 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:27.920709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.921444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.922120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.922933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.923481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.923967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.974944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:27.976013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:27.983067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.983893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.984513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:27.985578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:27.986042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:27.986466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:28.151320 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:28.159876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f2a25657-8090-4611-baa9-ab40418dd1fa tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1724 microversion: 2.1 time: 0.250590 Aug 06 20:43:28.160451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 294/596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:27 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:28.165342 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:28.166094 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:28.179347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:28.179845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:28.180282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:28.181127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:28.181591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:28.182016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:28.194729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:28.203441 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-28dbb4da-4a2b-4889-94b4-c82800752d65 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.232610 Aug 06 20:43:28.204343 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 303/597] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:27 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:28.366073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:28.377093 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:28.378585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:28.379768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a49c15f8-dd21-46cf-b19c-ebe26e9e5d25 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.218065 Aug 06 20:43:28.382689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 295/598] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:28 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:28.677433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:28.677927 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:28.683850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:28.684327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:28.684756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:28.685428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:28.686506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:28.686926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:28.715894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:28.716358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:28.716785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:28.717223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'fault' on Instance uuid 70795577-6b17-4729-9500-c1f804c6e525 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:28.761489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:28.769293 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d9b0cc27-847d-4844-a431-34ed42936099 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1332 microversion: 2.1 time: 0.095780 Aug 06 20:43:28.769865 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 304/599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:28 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:29.180905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:29.181508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:29.188426 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.188907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.189338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.190023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.190505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.190926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.225535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:29.226171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:29.233202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.233685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.234114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.234802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.235271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.235692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.369083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:29.377314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a75afdd7-1744-4eaa-9c17-ff31da71c66f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.200232 Aug 06 20:43:29.377868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 296/600] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:29 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:29.402015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:29.402621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:29.404271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:29.409289 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.409771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.410200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.410890 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.411431 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.411967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.412663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bc023827-f827-4959-b996-36232a2960cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1734 microversion: 2.1 time: 0.190782 Aug 06 20:43:29.413240 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 305/601] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:29 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:29.540657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:29.550134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:29.551053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:29.552241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-343c14e7-d011-4c19-b98d-0aa0f5250bfd tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.154209 Aug 06 20:43:29.552783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 297/602] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:29 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:29.790180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:29.790708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:29.797245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.797726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.798259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.798953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.799442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.799868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.830231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:29.831036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:29.831511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:29.831959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'fault' on Instance uuid 70795577-6b17-4729-9500-c1f804c6e525 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:29.876501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:29.884565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9621c80c-bd7c-4bc6-a93b-7031cab7bafd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 200 len: 1332 microversion: 2.1 time: 0.098286 Aug 06 20:43:29.885129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 306/603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:29 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:30.399171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.399861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.406763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.407266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.407708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.408401 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.408874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.409299 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.433837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.434560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.441098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.441584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.442013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.442699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.443148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.443597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.587697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:30.595723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-292430b2-e635-46f7-97df-1393de06e9a8 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.200289 Aug 06 20:43:30.600343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 298/604] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:30 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:30.600892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.601406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.607260 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.608401 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.608843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.609540 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.609998 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.610420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.622622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:30.630689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-dc9c9b68-eb20-4363-acf0-720dcf2303a2 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1714 microversion: 2.1 time: 0.200699 Aug 06 20:43:30.631269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 307/605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:30 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1714 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:30.690255 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.690738 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.696522 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.697002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.697430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.698120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.698566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.698984 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.743039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:30.751179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:30.751522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:30.753266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:30.754419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fa0f1178-ba35-451a-9f7e-ba40ce83b77d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.157211 Aug 06 20:43:30.755157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 299/606] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:30 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:30.824718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] HTTP exception thrown: Cannot 'detach_volume' instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb while it is in vm_state rescued Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Request method failure captured: Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments/59e41ea9-0353-4cbb-b7e9-e095e9e30e17 HTTP/1.1 Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEELyIMRoITCHkzXMoIpQLRdf1oT0v4kcW1kHwW3jNckvrY8Gnnm13WP3_dMbBCCnEEg2PmjgEvBkRpH9ZsGtH-Zd_y0aP9fcqwz1Ovf-H3UHoSYeeQedQPM7aqmQc7DkUWdN3lqybAWABrP-R0V0IHLnyCM5FFNBBQMBtKE74M6EI Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:43:30.826826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 919c94bd42144c9b86fd9977e85b0762 Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:43:30.828327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Cannot 'detach_volume' instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb while it is in vm_state rescued Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'server_id': '671c6efc-e2c0-4075-ab3e-32a56469d1fb', 'id': '59e41ea9-0353-4cbb-b7e9-e095e9e30e17'} Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:43:30.828973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb while it is in vm_state rescued Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb while it is in vm_state rescued Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.830316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Returning 409 to user: Cannot 'detach_volume' instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb while it is in vm_state rescued {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:43:30.831503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-01a09eec-8760-4117-a319-03b68bed0a3d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments/59e41ea9-0353-4cbb-b7e9-e095e9e30e17" status: 409 len: 152 microversion: 2.1 time: 0.141927 Aug 06 20:43:30.831503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 308/607] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:43:30 2022] DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments/59e41ea9-0353-4cbb-b7e9-e095e9e30e17 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 06 20:43:30.838264 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:30.838804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.845278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.845768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.846209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.846902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.847388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.847815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.851530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:30.907097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.907657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.914609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.915122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.915639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.916334 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.916796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.917224 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.920288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1b6209c7-2318-47c1-9d94-a93311a1a55f tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "POST /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/action" status: 202 len: 0 microversion: 2.1 time: 0.085624 Aug 06 20:43:30.921097 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 300/608] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:43:30 2022] POST /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:43:30.929352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.930085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:30.930484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 HTTP/1.1 Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:43:30.932007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:43:30.933366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '70795577-6b17-4729-9500-c1f804c6e525'} Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:43:30.937481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:43:30.938638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:30.939697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:43:30.939697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3e058e22-ec55-4674-aa96-c9b50cb99452 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 404 len: 111 microversion: 2.1 time: 0.031079 Aug 06 20:43:30.939697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 309/609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:30 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:43:30.939919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.939919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.939919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.939919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:30.940195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:30.940195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:30.941946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0915480f-b334-4f2e-b916-55fa74294382 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '.version_select at 0x7fba956ec550>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:30.962583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0915480f-b334-4f2e-b916-55fa74294382 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214462809" status: 202 len: 0 microversion: 2.1 time: 0.024246 Aug 06 20:43:30.963149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 310/610] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 20:43:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214462809 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:43:31.074658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:31.083666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7c5333d7-9e51-4801-a119-65a305b40e72 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1722 microversion: 2.1 time: 0.157966 Aug 06 20:43:31.084235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 301/611] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:30 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:31.617259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:31.617896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:31.620302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:31.620911 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:31.625155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.625648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.626087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.626779 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.627235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.627682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.628365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.628904 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.629402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.630153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.630709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.631197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.713411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'services' on Instance uuid 46acb22e-5b82-4d53-adae-81e616c05c32 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:31.788920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7c275b7f-f83b-457b-a6c0-94836fb0874b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments/e115c9dd-045d-4e35-bd4d-91c3239e3e81" status: 202 len: 0 microversion: 2.1 time: 0.172844 Aug 06 20:43:31.789670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 302/612] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:43:31 2022] DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments/e115c9dd-045d-4e35-bd4d-91c3239e3e81 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:43:31.794765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:31.796162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:31.803072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.803582 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.804335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.804708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.805213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.805615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.870049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:31.877960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fb289cc8-64fe-4810-aba1-0cfb5c29f3ea tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.265369 Aug 06 20:43:31.878684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 311/613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:31 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:31.889931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:31.893452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:31.903552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.905720 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.906488 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.907762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:31.908127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:31.910215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:31.941226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1a90a826-f2f3-445c-b731-e4b3822dcddc tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061334 Aug 06 20:43:31.941781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 312/614] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:43:31 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:31.983905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:31.992199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:31.993700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:31.994855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-802e1f62-dc90-45b5-8b17-a75472b49cf7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.204144 Aug 06 20:43:31.995505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 303/615] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:31 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:32.104786 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:32.105402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:32.112122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:32.112605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:32.113038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:32.113728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:32.114194 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:32.114619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:32.245093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:32.253631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7e2a4b7e-5918-49a5-9273-71214c102a35 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1722 microversion: 2.1 time: 0.152698 Aug 06 20:43:32.254132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 313/616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:32 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:32.899365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:32.899981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:32.906365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:32.906880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:32.907400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:32.908153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:32.908613 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:32.909040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:32.953765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:32.955908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:32.962515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:32.962993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:32.963468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:32.964158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:32.964614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:32.965051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:32.994837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-22de971c-6394-4e9e-9521-9d3c178a0eaa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045198 Aug 06 20:43:32.995636 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 314/617] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:43:32 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:43:33.017869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:33.019192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:33.027702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.028750 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.029427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.030404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.031585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.032028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.053452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:33.061857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e43b105e-a22a-4d9b-9d4a-2cc7da2572fe tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.165610 Aug 06 20:43:33.062433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 304/618] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:32 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:33.067288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:33.067790 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:33.073635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.074124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.074561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.075309 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.075745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.076262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.101129 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:43:33.180561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3321c0ad-ebd6-4e2c-b5c2-f37e7940a869 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 204 len: 0 microversion: 2.1 time: 0.116708 Aug 06 20:43:33.181152 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 305/619] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:43:33 2022] DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:43:33.181479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:33.192586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:33.192942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:33.193288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:33.194788 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:33.196265 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-df066f81-d927-4d86-810d-a4cce1477a45 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.182727 Aug 06 20:43:33.196896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 315/620] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:33 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:33.199823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.200319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.200765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.201997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.202460 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.202893 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.274935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:33.275596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:33.281736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.282231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.282672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.283400 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:33.283862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:33.284290 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:33.362476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:33.369924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-833be295-3ebe-486a-96b0-9472d24e79f5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1681 microversion: 2.1 time: 0.181426 Aug 06 20:43:33.370488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 306/621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:33 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:33.426252 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:33.434145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-744fa175-f160-4d76-bcca-d059af5451ce tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1722 microversion: 2.1 time: 0.163011 Aug 06 20:43:33.434704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 316/622] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:33 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:34.083745 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:34.084366 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:34.090770 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.091266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.091715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.092403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.092857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.093282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.220060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:34.220205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:34.220814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:34.227212 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.227505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f1a0fc9c-1c0d-4878-98ac-8ef9ea344a22 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.147846 Aug 06 20:43:34.227727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.228068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 307/623] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:34 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:34.228221 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.228835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.229286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.229707 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.356660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:34.365662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:34.367339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:34.368578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c724885c-47d1-489e-bd75-be94f5d90519 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.152704 Aug 06 20:43:34.369223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 317/624] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:34 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:34.392112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:34.392724 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:34.398508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.398991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.399481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.400176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.400634 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.401060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.462721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:34.463520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:34.470366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.470942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.471487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.472267 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:34.472818 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:34.473318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:34.571962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:34.580155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c8cbbd8f-c7e3-497e-b2fc-536c8f66768c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1681 microversion: 2.1 time: 0.192315 Aug 06 20:43:34.580950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 308/625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:34 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:34.633068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:34.641776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b30cbd3a-874f-49a8-8e62-cc2197ee9845 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1722 microversion: 2.1 time: 0.185223 Aug 06 20:43:34.642348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 318/626] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:34 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:35.249788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:35.250307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:35.256726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.257213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.257649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.258341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.258796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.259220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.391019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:35.391981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:35.392582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:35.398445 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.398926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.399256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d4d0752e-434c-455a-952a-2e1129bae18f tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.153986 Aug 06 20:43:35.399381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.399835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 309/627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:35 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:35.400066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.400514 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.400931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.533638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:35.546474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:35.548012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:35.549167 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9f9ca757-bb36-4f5d-aa07-b087cbc468ba tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.161931 Aug 06 20:43:35.549733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 319/628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:35 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:35.603662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:35.603796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:35.610326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.610813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.611266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.611969 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.612425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.612851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.663897 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:35.664502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:35.670978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.671532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.671971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.672675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:35.673129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:35.673552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:35.779698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:35.787280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fe86133c-2425-4612-aa88-36f879caa01f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1681 microversion: 2.1 time: 0.187824 Aug 06 20:43:35.787784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 310/629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:35 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:35.822427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:35.831018 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-db9b0d9b-5a04-4b9a-8c0d-247e17a03652 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1722 microversion: 2.1 time: 0.170884 Aug 06 20:43:35.831618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 320/630] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:35 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:36.420458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:36.421064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:36.427398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.427879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.428312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.428994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.429441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.429860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.450637 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-727e8248-7b2c-4ce8-aad4-b50a9559c42e req-bd031242-3f8f-4d44-b382-028c0f37cbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "name": "network-vif-plugged", "status": "completed", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:36.461765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-727e8248-7b2c-4ce8-aad4-b50a9559c42e req-bd031242-3f8f-4d44-b382-028c0f37cbf0 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.462290 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-727e8248-7b2c-4ce8-aad4-b50a9559c42e req-bd031242-3f8f-4d44-b382-028c0f37cbf0 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.462720 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-727e8248-7b2c-4ce8-aad4-b50a9559c42e req-bd031242-3f8f-4d44-b382-028c0f37cbf0 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.476512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-727e8248-7b2c-4ce8-aad4-b50a9559c42e req-bd031242-3f8f-4d44-b382-028c0f37cbf0 service nova] Creating event network-vif-plugged:b73fc326-7095-42f3-9b6f-f9cae7cc05ce for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 on hv-cinder-85199 Aug 06 20:43:36.481729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-727e8248-7b2c-4ce8-aad4-b50a9559c42e req-bd031242-3f8f-4d44-b382-028c0f37cbf0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035673 Aug 06 20:43:36.482730 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 321/631] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:43:36.564069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:36.571881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a69c7f44-3192-4436-8975-3b716b0c8582 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.155326 Aug 06 20:43:36.572038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:36.572477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 311/632] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:36 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:36.572680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:36.579579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.580074 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.580515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.581215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.581674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.582101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.715588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:36.723896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:36.725382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:36.726519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f8ce9bd0-c188-4827-857e-4daf07364bf9 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.158772 Aug 06 20:43:36.727076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 322/633] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:36 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:36.808120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:36.808751 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:36.815230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.815680 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.816108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.816785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.817236 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.817655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.851959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:36.852595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:36.859083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.859620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.860059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.860762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:36.861216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:36.861650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:36.996621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:37.004907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e4ab4997-ffc9-4d2a-af6a-56a01f5bd9c6 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1681 microversion: 2.1 time: 0.200596 Aug 06 20:43:37.005485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 312/634] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:36 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:37.023701 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:37.032068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-df106c04-1750-4966-90a9-1a2ba43f16eb tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1728 microversion: 2.1 time: 0.183913 Aug 06 20:43:37.032628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 323/635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:36 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:37.052565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:37.053060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:37.058914 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:37.059435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:37.059875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:37.060567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:37.061021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:37.061446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:37.074857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:37.142176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a421ba2d-89c4-4ca3-aaca-0e090527e114 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093314 Aug 06 20:43:37.142770 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 313/636] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:43:37 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:37.605168 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:37.606650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:37.614216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:37.615055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:37.615790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:37.617245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:37.617898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:37.618476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:37.749900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:37.750415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:37.756885 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:37.757714 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:37.757935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:37.758652 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:37.759110 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:37.759574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:37.932031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:37.940443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ab48e4b7-e12f-435d-a064-4a82d71dfd61 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.349995 Aug 06 20:43:37.941224 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 324/637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:37 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:38.028756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:38.030416 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:38.041855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:38.042155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:38.043573 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:38.044148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:38.050682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:38.051302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:38.051844 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:38.057775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:38.059423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:38.060650 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-028e5340-4055-4451-92fe-e97c71fc2a5e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.315203 Aug 06 20:43:38.067180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 314/638] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:37 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:38.130475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-531fa277-6572-43c0-817c-a5f85a080368 req-3fb3e8ae-619b-4c48-9acb-404d3e243a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671c6efc-e2c0-4075-ab3e-32a56469d1fb", "tag": "9bb66be5-6e4a-435a-bd7c-31d972c43b58"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:38.140333 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-531fa277-6572-43c0-817c-a5f85a080368 req-3fb3e8ae-619b-4c48-9acb-404d3e243a04 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:38.140809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-531fa277-6572-43c0-817c-a5f85a080368 req-3fb3e8ae-619b-4c48-9acb-404d3e243a04 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:38.141226 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-531fa277-6572-43c0-817c-a5f85a080368 req-3fb3e8ae-619b-4c48-9acb-404d3e243a04 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:38.152513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-531fa277-6572-43c0-817c-a5f85a080368 req-3fb3e8ae-619b-4c48-9acb-404d3e243a04 service nova] Creating event network-changed:9bb66be5-6e4a-435a-bd7c-31d972c43b58 for instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb on hv-cinder-85199 Aug 06 20:43:38.157929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-531fa277-6572-43c0-817c-a5f85a080368 req-3fb3e8ae-619b-4c48-9acb-404d3e243a04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095612 Aug 06 20:43:38.158874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 315/639] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:38.276225 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:38.284569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3e93e780-d6e0-4ea6-93cc-8534f055fd95 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1681 microversion: 2.1 time: 0.261961 Aug 06 20:43:38.285374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 325/640] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:38 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:38.678005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-c84440dd-93ac-4690-a787-9d7f46647a2f req-cc4b4813-03a1-4dea-896f-12e1e04e10ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46acb22e-5b82-4d53-adae-81e616c05c32", "name": "network-vif-deleted", "tag": "1e3edbbc-c6e8-46ad-99c0-ad3fc7356693"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:38.687371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-c84440dd-93ac-4690-a787-9d7f46647a2f req-cc4b4813-03a1-4dea-896f-12e1e04e10ec service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:38.687844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-c84440dd-93ac-4690-a787-9d7f46647a2f req-cc4b4813-03a1-4dea-896f-12e1e04e10ec service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:38.688269 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-c84440dd-93ac-4690-a787-9d7f46647a2f req-cc4b4813-03a1-4dea-896f-12e1e04e10ec service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:38.699429 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-c84440dd-93ac-4690-a787-9d7f46647a2f req-cc4b4813-03a1-4dea-896f-12e1e04e10ec service nova] Creating event network-vif-deleted:1e3edbbc-c6e8-46ad-99c0-ad3fc7356693 for instance 46acb22e-5b82-4d53-adae-81e616c05c32 on hv-cinder-85199 Aug 06 20:43:38.704806 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-c84440dd-93ac-4690-a787-9d7f46647a2f req-cc4b4813-03a1-4dea-896f-12e1e04e10ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030445 Aug 06 20:43:38.708741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 316/641] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:38.964676 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:38.965889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:38.974241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:38.975052 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:38.975607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:38.976408 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:38.977885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:38.978430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:39.084921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:39.086455 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:39.094644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:39.095148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:39.095643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:39.096557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:39.097021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:39.097454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:39.229504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:39.246366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-48517807-7959-4c31-9c45-a8bec84a237b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.287831 Aug 06 20:43:39.247139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 326/642] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:38 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:39.287488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:39.295946 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:39.297537 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:39.298700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1dec71aa-83a7-494f-be3c-9464e1d19664 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1808 microversion: 2.20 time: 0.218995 Aug 06 20:43:39.299269 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 317/643] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:39 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:43:39.305219 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:39.306026 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:39.313313 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:39.313804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:39.314418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:39.315117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:39.315763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:39.316194 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:39.331998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:39.349125 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:39.349607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:39.350035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:39.350487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'fault' on Instance uuid 46acb22e-5b82-4d53-adae-81e616c05c32 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:43:39.402815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:39.411570 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-84313e8e-6a27-469e-b021-6b011c1b076b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 200 len: 1332 microversion: 2.1 time: 0.110050 Aug 06 20:43:39.412327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 327/644] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:39 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:40.175359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-2c9cde48-e18d-41ee-aa1e-adc9dd611c62 req-3ea41936-5162-4549-afaf-353a9b06e663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "671c6efc-e2c0-4075-ab3e-32a56469d1fb", "tag": "9bb66be5-6e4a-435a-bd7c-31d972c43b58"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:40.185016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-2c9cde48-e18d-41ee-aa1e-adc9dd611c62 req-3ea41936-5162-4549-afaf-353a9b06e663 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.185521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-2c9cde48-e18d-41ee-aa1e-adc9dd611c62 req-3ea41936-5162-4549-afaf-353a9b06e663 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.185942 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-2c9cde48-e18d-41ee-aa1e-adc9dd611c62 req-3ea41936-5162-4549-afaf-353a9b06e663 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.196418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-2c9cde48-e18d-41ee-aa1e-adc9dd611c62 req-3ea41936-5162-4549-afaf-353a9b06e663 service nova] Creating event network-changed:9bb66be5-6e4a-435a-bd7c-31d972c43b58 for instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb on hv-cinder-85199 Aug 06 20:43:40.201146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-2c9cde48-e18d-41ee-aa1e-adc9dd611c62 req-3ea41936-5162-4549-afaf-353a9b06e663 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029397 Aug 06 20:43:40.201695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 318/645] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:40.268723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:40.269543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:40.276201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.276705 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.277205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.278020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.278546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.279673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.322440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:40.323765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:40.330054 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.330541 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.330971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.331694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.332146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.332566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.517834 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:40.525594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f3cf7966-c365-4dcf-bf2f-41aa0db66f53 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.261677 Aug 06 20:43:40.526192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 328/646] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:40 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:40.530732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:40.531814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:40.537433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.537918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.538354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.539043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:40.539532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:40.539965 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:40.553683 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 HTTP/1.1 Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:43:40.555450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:43:40.556899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '46acb22e-5b82-4d53-adae-81e616c05c32'} Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:43:40.557678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:43:40.558884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:43:40.559983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:43:40.559983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6af6b95d-a344-40e2-b604-10834d9c449a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 404 len: 111 microversion: 2.1 time: 0.029715 Aug 06 20:43:40.559983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 329/647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:40 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:43:40.566050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eff11f6a-a153-4c9f-814a-dd7847e6543d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '.version_select at 0x7fba956ecaf0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:40.590203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eff11f6a-a153-4c9f-814a-dd7847e6543d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144500751" status: 202 len: 0 microversion: 2.1 time: 0.027668 Aug 06 20:43:40.590982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 330/648] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 20:43:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144500751 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:43:40.593034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:40.605321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:40.606930 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:40.608865 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7e39a8b9-b3fa-4787-a202-44d062873875 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1795 microversion: 2.20 time: 0.290578 Aug 06 20:43:40.609507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 319/649] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:43:40 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1795 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:43:41.229889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-96551e43-787f-470b-b5f1-5b33afac6b41 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: .version_select at 0x7fba9567b550>, body: {"keypair": {"name": "tempest-keypair-1269510951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYDBOgR9QmaCLniJnD7Qnp6O/5EHsJONaukpoh+EVNAotNUUpakqugf+hvb2wEPsmDdGx+KmUk3VDwT/JyEjTba7yWupqJybtmca28TZuY9q5XPqQQwmv27hjG+0O1f9A=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:41.245462 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-96551e43-787f-470b-b5f1-5b33afac6b41 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:43:41.249243 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-96551e43-787f-470b-b5f1-5b33afac6b41 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:43:41.271317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-96551e43-787f-470b-b5f1-5b33afac6b41 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045311 Aug 06 20:43:41.271904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 331/650] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:43:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:43:41.548968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:41.549877 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:41.556543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:41.557281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:41.557611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:41.558442 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:41.558909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:41.559375 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:41.693027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:41.701938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ab24b1c4-14b4-4d51-8a12-3648c084c12c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.157589 Aug 06 20:43:41.702539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 320/651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:41 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:42.502547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-246394266", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "204900d1-dea4-474e-a19d-da292c4d4d6a"}], "security_groups": [{"name": "tempest-securitygroup--1451968042"}], "key_name": "tempest-keypair-1269510951", "user_data": "}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:42.602334 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] validate_networks() for [('204900d1-dea4-474e-a19d-da292c4d4d6a', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:43:42.722991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:42.723637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:42.730063 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:42.730575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:42.731011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:42.731727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:42.732180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:42.733095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:42.926299 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:42.933784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4d655ca0-a3b7-48e9-af93-fba6502e7394 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.214588 Aug 06 20:43:42.934439 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 321/652] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:42 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:43:43.046244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:43:43.046857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:43:43.047536 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:43:43.047994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:43:43.048412 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:43:43.057046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:43.057532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:43.057969 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:43.058699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:43.059158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:43.059617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:43.077662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:43:43.081591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:43:43.092792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:43:43.100703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:43:43.121824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:43.150096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ac154f36-c08d-458b-9939-098b4c744b78 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.652802 Aug 06 20:43:43.150752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 332/653] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:43:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:43:43.161630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a941770a-2dcf-4535-a669-1186f1c3d209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:43.162308 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a941770a-2dcf-4535-a669-1186f1c3d209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:43.215443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a941770a-2dcf-4535-a669-1186f1c3d209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:43.222101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a941770a-2dcf-4535-a669-1186f1c3d209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1241 microversion: 2.1 time: 0.064380 Aug 06 20:43:43.222682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 322/654] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:43 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:43.955904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:43.956518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:43.963018 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:43.963534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:43.963974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:43.964664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:43.965122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:43.965549 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:44.092167 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:44.099606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-402df37e-5d09-48ba-b359-35926ea46124 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1678 microversion: 2.1 time: 0.148401 Aug 06 20:43:44.100159 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 333/655] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:43 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:44.241616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-904bf5f5-59a8-435e-ad0a-3a4478ee70e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:44.242219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-904bf5f5-59a8-435e-ad0a-3a4478ee70e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:44.296750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-904bf5f5-59a8-435e-ad0a-3a4478ee70e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:44.305625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-904bf5f5-59a8-435e-ad0a-3a4478ee70e5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1241 microversion: 2.1 time: 0.067766 Aug 06 20:43:44.306180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 323/656] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:44 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:45.120752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:45.121360 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:45.127688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:45.128166 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:45.128595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:45.129279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:45.129728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:45.130154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:45.254934 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:45.262490 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7c834d03-b7eb-4138-b63a-67ff22a2f13c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1655 microversion: 2.1 time: 0.145530 Aug 06 20:43:45.263238 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 334/657] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:45 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:45.282930 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bed24065-8e64-4d47-8e8b-1de4f62574bf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:45.289395 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bed24065-8e64-4d47-8e8b-1de4f62574bf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:45.289779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bed24065-8e64-4d47-8e8b-1de4f62574bf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:45.290206 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bed24065-8e64-4d47-8e8b-1de4f62574bf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:45.311705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bed24065-8e64-4d47-8e8b-1de4f62574bf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Going to try to start instance {{(pid=129476) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 20:43:45.325834 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8bd3406a-c896-41e1-85b2-d3e1921b4e1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:45.327406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8bd3406a-c896-41e1-85b2-d3e1921b4e1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:45.360982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bed24065-8e64-4d47-8e8b-1de4f62574bf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action" status: 202 len: 0 microversion: 2.1 time: 0.079282 Aug 06 20:43:45.361204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 324/658] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:43:45 2022] POST /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:43:45.379466 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:45.380103 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:45.387188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:45.387713 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:45.388170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:45.388320 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8bd3406a-c896-41e1-85b2-d3e1921b4e1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:45.389424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:45.389880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:45.390305 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:45.395808 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8bd3406a-c896-41e1-85b2-d3e1921b4e1d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1241 microversion: 2.1 time: 0.073925 Aug 06 20:43:45.396793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 335/659] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:45 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:45.577685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:45.585889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c9e4817a-e729-4f2b-b269-a2e9e1082532 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1664 microversion: 2.1 time: 0.211282 Aug 06 20:43:45.586555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 325/660] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:45 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:46.417230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c7b874be-eb5e-431f-8fdc-5f5974eb1999 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:46.417835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c7b874be-eb5e-431f-8fdc-5f5974eb1999 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:46.476521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c7b874be-eb5e-431f-8fdc-5f5974eb1999 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:46.484230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c7b874be-eb5e-431f-8fdc-5f5974eb1999 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1241 microversion: 2.1 time: 0.070785 Aug 06 20:43:46.484779 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 336/661] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:46 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:46.605834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:46.606489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:46.616062 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:46.616565 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:46.617081 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:46.618061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:46.619446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:46.619799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:46.751119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:46.758606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4103e28c-ca47-4688-a9bf-59472331d446 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1668 microversion: 2.1 time: 0.156606 Aug 06 20:43:46.759172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 326/662] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:46 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:47.504098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:47.504700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:47.511032 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:47.511526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:47.511957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:47.512638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:47.513088 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:47.513502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:47.576398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:47.584279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c2d565cc-a1fe-44e0-a57a-41f96f3a602e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1245 microversion: 2.1 time: 0.083942 Aug 06 20:43:47.584837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 337/663] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:47 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:48.604639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:48.605242 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:48.611855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:48.612330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:48.612758 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:48.613463 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:48.613913 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:48.614333 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:48.686387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:48.694262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-29f0f821-d891-452f-99c5-0dcddc2055d5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1299 microversion: 2.1 time: 0.093516 Aug 06 20:43:48.694827 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 327/664] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:48 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:49.714195 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:49.714796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:49.721722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:49.722197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:49.722624 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:49.723323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:49.723778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:49.724194 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:49.824510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-1d18501c-ed4a-4ed5-afdd-c3dc17092c77 req-752bceca-abb7-4b5d-a4b3-335d3a488cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edade601-e01d-4bf7-ab7e-f9f48c518314", "tag": "6962f219-ff80-49d1-bfc9-42a98f3f6cef"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:49.832700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:49.837595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-1d18501c-ed4a-4ed5-afdd-c3dc17092c77 req-752bceca-abb7-4b5d-a4b3-335d3a488cb4 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:49.838268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-1d18501c-ed4a-4ed5-afdd-c3dc17092c77 req-752bceca-abb7-4b5d-a4b3-335d3a488cb4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:49.838707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-1d18501c-ed4a-4ed5-afdd-c3dc17092c77 req-752bceca-abb7-4b5d-a4b3-335d3a488cb4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:49.850630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-1d18501c-ed4a-4ed5-afdd-c3dc17092c77 req-752bceca-abb7-4b5d-a4b3-335d3a488cb4 service nova] Creating event network-changed:6962f219-ff80-49d1-bfc9-42a98f3f6cef for instance edade601-e01d-4bf7-ab7e-f9f48c518314 on hv-cinder-85199 Aug 06 20:43:49.855380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-1d18501c-ed4a-4ed5-afdd-c3dc17092c77 req-752bceca-abb7-4b5d-a4b3-335d3a488cb4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035212 Aug 06 20:43:49.856295 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 328/665] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:43:49.935676 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:49.943237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-57b4e502-4f0a-4406-8d7b-35d95f217126 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.232939 Aug 06 20:43:49.943823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 338/666] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:49 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:50.965202 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:50.965812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:50.972506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:50.972991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:50.973432 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:50.974112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:50.974566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:50.974991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:51.113292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:51.120654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d0b27245-3c8a-4dc5-90d1-2ba1454ce534 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.160233 Aug 06 20:43:51.121220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 329/667] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:50 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:52.141322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:52.141930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:52.148437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:52.148922 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:52.149388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:52.150075 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:52.150529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:52.150953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:52.275277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:52.283057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-10f4c45c-ff01-4ded-ba43-5c005f2d663f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.145586 Aug 06 20:43:52.283658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 339/668] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:52 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:53.303846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:53.304458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:53.310809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:53.311397 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:53.311838 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:53.312530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:53.312985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:53.313413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:53.440409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:53.449399 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-da6f3b8d-ff08-4b67-bb86-68526f667aac tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.149138 Aug 06 20:43:53.449979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 330/669] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:53 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:54.472038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:54.472643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:54.474459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:54.480048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:54.480534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:54.480963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:54.481654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:54.482102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:54.482519 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:54.615599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:54.623772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-61d05d92-adfb-4480-91b7-6b8a33dffbd7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.155613 Aug 06 20:43:54.624240 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 340/670] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:54 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:55.645339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:55.645948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:55.647902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=4 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:55.654763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:55.655319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:55.655766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:55.656468 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:55.656928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:55.657378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:55.782857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:55.790288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c7ba520b-e428-4053-82b3-111d0e465f96 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.148897 Aug 06 20:43:55.791141 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 331/671] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:55 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:56.546741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-245a02e2-2fbc-447b-acb4-3e08fe5efde8 req-ea52f434-d562-43f4-96ab-84d66e0fa9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edade601-e01d-4bf7-ab7e-f9f48c518314", "name": "network-vif-plugged", "status": "completed", "tag": "6962f219-ff80-49d1-bfc9-42a98f3f6cef"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:43:56.552133 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=14 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:56.558019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-245a02e2-2fbc-447b-acb4-3e08fe5efde8 req-ea52f434-d562-43f4-96ab-84d66e0fa9a9 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:56.558497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-245a02e2-2fbc-447b-acb4-3e08fe5efde8 req-ea52f434-d562-43f4-96ab-84d66e0fa9a9 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:56.558926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-245a02e2-2fbc-447b-acb4-3e08fe5efde8 req-ea52f434-d562-43f4-96ab-84d66e0fa9a9 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:56.570275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-245a02e2-2fbc-447b-acb4-3e08fe5efde8 req-ea52f434-d562-43f4-96ab-84d66e0fa9a9 service nova] Creating event network-vif-plugged:6962f219-ff80-49d1-bfc9-42a98f3f6cef for instance edade601-e01d-4bf7-ab7e-f9f48c518314 on hv-cinder-85199 Aug 06 20:43:56.575215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-245a02e2-2fbc-447b-acb4-3e08fe5efde8 req-ea52f434-d562-43f4-96ab-84d66e0fa9a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Aug 06 20:43:56.576050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 341/672] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:43:56.810821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:56.811560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:56.818100 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:56.818589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:56.819195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:56.819921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:56.820370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:56.820796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:56.966113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:56.974021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f22e7d3a-573e-4beb-acac-47ae2a287250 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.167075 Aug 06 20:43:56.974573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 332/673] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:56 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:57.994870 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:57.995538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:58.002120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:58.002611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:58.003048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:58.003758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:58.004215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:58.004642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:58.131148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:58.138563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bc9c4921-e902-4ef9-bdbd-7bd683995511 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1367 microversion: 2.1 time: 0.148306 Aug 06 20:43:58.139129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 342/674] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:57 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:59.158805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:59.159447 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:59.165871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:59.166348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:59.166775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:59.167521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:59.167968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:59.168386 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:59.297266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:43:59.304611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d00340ea-3f45-4bbb-86f3-8ac62bcd2851 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1556 microversion: 2.1 time: 0.149791 Aug 06 20:43:59.305188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 333/675] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:43:59 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:43:59.324835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:43:59.325330 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:43:59.331809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:59.332290 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:59.332731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:59.333418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:43:59.334139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:43:59.334562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:43:59.411555 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bbd1d11e-e8c1-45f1-95c5-cb88ae467049 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090410 Aug 06 20:43:59.412184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 343/676] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:43:59 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:00.570965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-5e24caa5-e96a-47a2-89d7-03171a1300a5 req-9feaac3e-335a-4541-b184-e0bb7782d279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edade601-e01d-4bf7-ab7e-f9f48c518314", "tag": "6962f219-ff80-49d1-bfc9-42a98f3f6cef"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:00.581633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5e24caa5-e96a-47a2-89d7-03171a1300a5 req-9feaac3e-335a-4541-b184-e0bb7782d279 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:00.582547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5e24caa5-e96a-47a2-89d7-03171a1300a5 req-9feaac3e-335a-4541-b184-e0bb7782d279 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:00.582987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5e24caa5-e96a-47a2-89d7-03171a1300a5 req-9feaac3e-335a-4541-b184-e0bb7782d279 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:00.587334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:00.599300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-5e24caa5-e96a-47a2-89d7-03171a1300a5 req-9feaac3e-335a-4541-b184-e0bb7782d279 service nova] Creating event network-changed:6962f219-ff80-49d1-bfc9-42a98f3f6cef for instance edade601-e01d-4bf7-ab7e-f9f48c518314 on hv-cinder-85199 Aug 06 20:44:00.601421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-5e24caa5-e96a-47a2-89d7-03171a1300a5 req-9feaac3e-335a-4541-b184-e0bb7782d279 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033748 Aug 06 20:44:00.602241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 334/677] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:41.414940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=26 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.416149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=63 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.420893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:41.421380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:41.428291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:41.428768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:41.429201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:41.429908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:41.430362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:41.430785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:41.510157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lazy-loading 'services' on Instance uuid 671c6efc-e2c0-4075-ab3e-32a56469d1fb {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:44:41.626002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9a650179-5dab-48f6-9057-8fcec3e12d0b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments/59e41ea9-0353-4cbb-b7e9-e095e9e30e17" status: 202 len: 0 microversion: 2.1 time: 0.212328 Aug 06 20:44:41.626657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 344/678] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:44:41 2022] DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments/59e41ea9-0353-4cbb-b7e9-e095e9e30e17 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:44:41.636447 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:41.638782 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:41.641799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=13 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:41.648083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:41.648582 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:41.649011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:41.649736 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:41.650188 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:41.650614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:41.685029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fa72f7f4-b18f-4fef-942c-8158d8d4f3cf tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053617 Aug 06 20:44:41.685638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 335/679] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:44:41 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:42.698472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:42.700870 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:42.707318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:42.707819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:42.708260 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:42.708966 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:42.709682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:42.710114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:42.741639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c0e1081c-71e0-485d-9bae-4b07b4bc3e04 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047858 Aug 06 20:44:42.742199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 345/680] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:44:42 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:44:42.822311 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:42.822860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:42.829190 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:42.829699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:42.830136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:42.830815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:42.831284 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:42.831706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:42.856322 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:44:42.926698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-00d0e76e-2c70-44db-bb26-94e43cabc84e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 204 len: 0 microversion: 2.1 time: 0.107978 Aug 06 20:44:42.927573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 336/681] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:44:42 2022] DELETE /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:44:42.935966 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:42.936569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:42.942332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:42.942820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:42.943257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:42.943943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:42.944391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:42.944809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:43.070450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:43.077846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-57c22646-462a-4bfa-8405-2f2988795b02 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1688 microversion: 2.1 time: 0.146373 Aug 06 20:44:43.078378 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 346/682] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:42 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:44.099962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:44.100662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:44.107132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:44.107659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:44.108095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:44.108791 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:44.109256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:44.109671 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:44.240152 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:44.248166 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9005f50a-06d9-4177-876e-a7607792843e tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1688 microversion: 2.1 time: 0.152375 Aug 06 20:44:44.248727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 337/683] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:44 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:45.268650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:45.269260 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:45.275635 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:45.276122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:45.276565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:45.277252 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:45.278281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:45.278711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:45.408849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:45.416217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a6fdcd35-5ca7-4913-8cbd-ed95947e43ab tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1688 microversion: 2.1 time: 0.151400 Aug 06 20:44:45.416800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 347/684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:45 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:45.869522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:45.870000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:45.876451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:45.876925 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:45.877354 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:45.878034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:45.878483 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:45.878902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:45.906387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-74c61eac-f1d4-454b-baa2-c570d5bcae75 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments/42da4cf5-c41f-4643-94e4-f28fa90b7c84" status: 200 len: 194 microversion: 2.20 time: 0.137481 Aug 06 20:44:45.906942 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 338/685] 10.222.0.17 () {60 vars in 1454 bytes} [Sat Aug 6 20:44:45 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments/42da4cf5-c41f-4643-94e4-f28fa90b7c84 => generated 194 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:45.982638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:45.983210 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:45.989187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:45.989673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:45.990108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:45.990799 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:45.991269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:45.991703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:46.069674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lazy-loading 'services' on Instance uuid 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:44:46.138681 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-82bfb077-3565-49b6-8987-a0bcb52e14ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments/42da4cf5-c41f-4643-94e4-f28fa90b7c84" status: 202 len: 0 microversion: 2.20 time: 0.160345 Aug 06 20:44:46.139266 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 348/686] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Aug 6 20:44:45 2022] DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments/42da4cf5-c41f-4643-94e4-f28fa90b7c84 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:44:46.147812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:46.150201 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:46.157000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:46.157524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:46.157970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:46.158751 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:46.159215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:46.159671 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:46.188828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a21d44b7-0c94-45b3-9bfc-1e150d2e711b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044994 Aug 06 20:44:46.189395 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 339/687] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 20:44:46 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:46.438361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:46.438981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:46.445523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:46.446006 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:46.446437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:46.447122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:46.447603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:46.448028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:46.574959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:46.582399 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-11b9ab49-cd69-451f-b2c4-29ae3e0ca74b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1688 microversion: 2.1 time: 0.148301 Aug 06 20:44:46.582959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 349/688] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:46 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:47.201551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:47.203702 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:47.209995 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:47.210705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:47.211144 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:47.211861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:47.212318 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:47.212741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:47.241668 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-81e0fbc9-55c2-426b-844e-7018b2d9ee08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044528 Aug 06 20:44:47.242223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 340/689] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 20:44:47 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:44:47.606297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:47.607012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:47.613721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:47.614211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:47.614651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:47.615389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:47.615853 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:47.616284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:47.682990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:47.690964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-645b2881-801c-437e-8f9c-2bc5ec3556af tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 200 len: 1621 microversion: 2.1 time: 0.089961 Aug 06 20:44:47.691591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 350/690] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:47 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 1621 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:47.849766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-3cf05435-e9fe-4b30-8151-4df89e6152b7 req-3e6026cc-0d06-4088-9049-8b60d6a50286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "671c6efc-e2c0-4075-ab3e-32a56469d1fb", "name": "network-vif-deleted", "tag": "9bb66be5-6e4a-435a-bd7c-31d972c43b58"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:47.859167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3cf05435-e9fe-4b30-8151-4df89e6152b7 req-3e6026cc-0d06-4088-9049-8b60d6a50286 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:47.859464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3cf05435-e9fe-4b30-8151-4df89e6152b7 req-3e6026cc-0d06-4088-9049-8b60d6a50286 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:47.859953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3cf05435-e9fe-4b30-8151-4df89e6152b7 req-3e6026cc-0d06-4088-9049-8b60d6a50286 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:47.881217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-3cf05435-e9fe-4b30-8151-4df89e6152b7 req-3e6026cc-0d06-4088-9049-8b60d6a50286 service nova] Creating event network-vif-deleted:9bb66be5-6e4a-435a-bd7c-31d972c43b58 for instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb on hv-cinder-85199 Aug 06 20:44:47.892152 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-3cf05435-e9fe-4b30-8151-4df89e6152b7 req-3e6026cc-0d06-4088-9049-8b60d6a50286 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045966 Aug 06 20:44:47.892878 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 341/691] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:48.254177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:48.256492 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:48.263023 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.263547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.263992 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.264688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.265148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.265580 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.294060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a71ef061-1d8d-48f7-9784-e17ed221cbe4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043817 Aug 06 20:44:48.294630 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 351/692] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 20:44:48 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:44:48.361252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:48.361851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:48.368213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.368963 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.369176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.369881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.370339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.371856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.398768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:44:48.480294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3c6b5fee-e9ab-4f11-87e5-ada9e3269c2d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 204 len: 0 microversion: 2.20 time: 0.123298 Aug 06 20:44:48.481488 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 342/693] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 20:44:48 2022] DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:44:48.489633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:48.490230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:48.497498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.497903 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.498363 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.499695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.500299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.500757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.640434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:48.648847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:48.650356 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:48.651559 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-29ea73e5-ae47-46c3-9198-9f8bda3d2dc5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.165933 Aug 06 20:44:48.652111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 352/694] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:48 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:44:48.712530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:48.713224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 671c6efc-e2c0-4075-ab3e-32a56469d1fb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:48.719585 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.720151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.720589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.721296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:48.721774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:48.722262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:48.735776 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] HTTP exception thrown: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb could not be found. Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Request method failure captured: Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb HTTP/1.1 Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEELyIMRoITCHkzXMoIpQLRdf1oT0v4kcW1kHwW3jNckvrY8Gnnm13WP3_dMbBCCnEEg2PmjgEvBkRpH9ZsGtH-Zd_y0aP9fcqwz1Ovf-H3UHoSYeeQedQPM7aqmQc7DkUWdN3lqybAWABrP-R0V0IHLnyCM5FFNBBQMBtKE74M6EI Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:44:48.737568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 919c94bd42144c9b86fd9977e85b0762 Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb could not be found. Aug 06 20:44:48.739104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '671c6efc-e2c0-4075-ab3e-32a56469d1fb'} Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb could not be found. Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:44:48.742957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb could not be found. Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb could not be found. Aug 06 20:44:48.744199 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:48.745249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Returning 404 to user: Instance 671c6efc-e2c0-4075-ab3e-32a56469d1fb could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:44:48.745249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-990f69e6-1a2b-43ed-80a9-5da030d83665 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb" status: 404 len: 111 microversion: 2.1 time: 0.030890 Aug 06 20:44:48.745249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 343/695] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:48 2022] GET /compute/v2.1/servers/671c6efc-e2c0-4075-ab3e-32a56469d1fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:44:48.747443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6c0fea7b-1d34-44dd-96d6-77832dba2c3b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '.version_select at 0x7fba9567b3a0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:48.766572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6c0fea7b-1d34-44dd-96d6-77832dba2c3b tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779768967" status: 202 len: 0 microversion: 2.1 time: 0.022732 Aug 06 20:44:48.767201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 353/696] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 20:44:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779768967 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:44:49.673884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:49.674495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:49.681294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:49.682056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:49.682674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:49.683797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:49.684400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:49.684828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:49.817724 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:49.826065 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:49.827591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:49.828738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-92dc197e-47d7-4195-8f4f-e8d2b857ffd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.158743 Aug 06 20:44:49.829284 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 344/697] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:49 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:44:50.213765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:50.215881 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:50.222825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.223345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.223787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.224473 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.224936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.225363 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.253406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-12a99e8e-1fd4-496d-b7e4-cfdea45a51b1 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043918 Aug 06 20:44:50.253948 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 354/698] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:44:50 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:44:50.313575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:50.314096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:50.319910 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.320388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.320817 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.321493 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.321948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.322370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.347759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:44:50.423223 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fc522a04-0e77-466a-b63f-a9e33c75aaa9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 204 len: 0 microversion: 2.1 time: 0.113114 Aug 06 20:44:50.424124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 345/699] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:44:50 2022] DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:44:50.433042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:50.433653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:50.440076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.440569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.441004 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.441684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.442140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.442560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.569784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:50.577258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6fb06978-c363-4f6e-a6c7-73cd544e4eae tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1674 microversion: 2.1 time: 0.147988 Aug 06 20:44:50.577825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 355/700] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:50 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:50.851874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:50.852561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:50.858785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.859298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.859738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.860425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:50.860873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:50.861295 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:50.991513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:51.000118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:51.001603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:51.002748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-db1ce237-f92d-4267-a940-ca164b0d2c82 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1723 microversion: 2.20 time: 0.155162 Aug 06 20:44:51.003316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 346/701] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:50 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:44:51.599167 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:51.599847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:51.608050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:51.608837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:51.609304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:51.610006 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:51.610464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:51.610885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:51.863861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:51.864436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:51.870804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:51.871355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:51.871790 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:51.872486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:51.872933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:51.873353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:51.896188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:51.898340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:44:51.901398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:51.905301 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ed4668f7-93c3-4de3-b337-f7a4f9069a56 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1674 microversion: 2.1 time: 0.309924 Aug 06 20:44:51.918798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 356/702] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:51 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1674 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:51.985527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4e9db459-89a8-43a2-b175-e1b5328d5ac0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 204 len: 0 microversion: 2.1 time: 0.124905 Aug 06 20:44:51.986601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 347/703] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:44:51 2022] DELETE /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 20:44:51.995789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:51.997062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:52.003172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.003774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.004328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:52.005118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.005654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.006155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:52.026403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:52.027235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:52.033644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.034219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.034789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:52.035587 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.036120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.036615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:52.182769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:52.193241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:52.195108 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:52.198239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c0a7ead2-bbef-412d-9208-d4067daa71bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1655 microversion: 2.20 time: 0.176584 Aug 06 20:44:52.199226 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 348/704] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:52 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:44:52.345704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:52.353056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6773b203-e0b1-46e2-8674-ea96f62c01f1 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1507 microversion: 2.1 time: 0.361473 Aug 06 20:44:52.353617 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 357/705] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:51 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:44:52.485619 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-d2a4a2c0-0a36-4610-8c90-f8c21e82592e req-20fde755-11ba-4d92-a5e1-69e9e8bfffcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4", "name": "network-vif-deleted", "tag": "b73fc326-7095-42f3-9b6f-f9cae7cc05ce"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:52.501332 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-d2a4a2c0-0a36-4610-8c90-f8c21e82592e req-20fde755-11ba-4d92-a5e1-69e9e8bfffcf service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.502240 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-d2a4a2c0-0a36-4610-8c90-f8c21e82592e req-20fde755-11ba-4d92-a5e1-69e9e8bfffcf service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.503053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-d2a4a2c0-0a36-4610-8c90-f8c21e82592e req-20fde755-11ba-4d92-a5e1-69e9e8bfffcf service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:52.518516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-d2a4a2c0-0a36-4610-8c90-f8c21e82592e req-20fde755-11ba-4d92-a5e1-69e9e8bfffcf service nova] Creating event network-vif-deleted:b73fc326-7095-42f3-9b6f-f9cae7cc05ce for instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 on hv-cinder-85199 Aug 06 20:44:52.524323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-d2a4a2c0-0a36-4610-8c90-f8c21e82592e req-20fde755-11ba-4d92-a5e1-69e9e8bfffcf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044017 Aug 06 20:44:52.525400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 349/706] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:52.926147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:52.926766 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:52.932875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.933361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.934324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:52.935027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:52.938019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:52.938507 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:53.061158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:53.078352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-64d45177-e2c4-409e-8f65-84192ab915e9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 200 len: 1606 microversion: 2.1 time: 0.155898 Aug 06 20:44:53.079281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 358/707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:52 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 1606 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:53.228052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:53.229345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:53.256321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:53.256836 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:53.257276 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:53.258193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:53.263529 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:53.264056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:53.346286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:53.347543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:53.348190 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:53.349310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lazy-loading 'fault' on Instance uuid 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:44:53.374484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:53.375197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:53.384510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:53.386356 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:53.392349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:53.393238 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:53.393836 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:53.394241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:53.458175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:53.477243 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:53.481963 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:53.484972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5a6951fe-4542-413c-a853-cd62ba85aa03 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 200 len: 1370 microversion: 2.20 time: 0.264050 Aug 06 20:44:53.485654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 350/708] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:53 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:44:53.657703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:53.670994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ccf12af1-7238-45db-a47d-d89f3904aa14 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 200 len: 1507 microversion: 2.1 time: 0.300750 Aug 06 20:44:53.683304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 359/709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:53 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:44:54.099356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.099915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:54.106498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.106992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.107462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.108812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.109272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.109697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.126077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] HTTP exception thrown: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Request method failure captured: Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b HTTP/1.1 Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEB-skkaGPjiC2hfCOkA9GjUxe9JKS7kYBdU0G4a7gRj6RJDhI3Rq64igZbpRsrgF8aS7e5N9TC-atSBfFuRyZxiDqvdZ7X_HAjRcwdAK3pqrtRBX_gGVKPj4KlnOm31pMJjCVsykDYTwpwLm2L6AqNFKOsiACSEjsH8SmPha8_A2Q Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:44:54.127759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 86090cd4247d4d598eb1976f4224b4f3 Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:44:54.129304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '72752a0b-3b0b-428e-b578-4958b8a51a1b'} Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:44:54.130138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:44:54.131304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.132336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Returning 404 to user: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:44:54.132336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-35b9fa99-59ea-408a-a00a-2712eb3bbb0b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 404 len: 111 microversion: 2.1 time: 0.033745 Aug 06 20:44:54.132336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 351/710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:54 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:44:54.138473 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-63fd85d2-f6be-4cd2-a4df-fdfc47e87f55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '.version_select at 0x7fba9580d9d0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.159035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-63fd85d2-f6be-4cd2-a4df-fdfc47e87f55 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096327027" status: 202 len: 0 microversion: 2.1 time: 0.024871 Aug 06 20:44:54.162886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 360/711] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 20:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1096327027 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:44:54.512006 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.512710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:54.519970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.520639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.521300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.522090 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.522617 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.523143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.542105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] HTTP exception thrown: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Request method failure captured: Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 HTTP/1.1 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tGDfes_xtQozvih3HwnFDYatcnCP10nBx9YeMcVBrTo7jCmtOK0Qz9i4N0Ie25S28L0UOjCMhl4GfXJqPYGhXwn1jTwp6S42c4nGozKMXFcVvGLTV_4L3UsUYJtjyqjcOcGNPOP1B7Q7xyFwiBBvbybBJ8tMlrkQFAQiS4gKtutEXw Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:44:54.544436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 8dcb94f981244d569f1dd791a4d911ac Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:44:54.545766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4'} Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:44:54.547032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:44:54.548208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.549411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Returning 404 to user: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:44:54.549411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c0c39779-e1b9-45ee-884c-6cb40e840670 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 404 len: 111 microversion: 2.20 time: 0.038031 Aug 06 20:44:54.555277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2a6b2b9c-aa5a-475b-9be8-f435f53b4d4f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '.version_select at 0x7fba956de4c0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.560190 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 352/712] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:54 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:44:54.568680 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72752a0b-3b0b-428e-b578-4958b8a51a1b", "name": "network-vif-deleted", "tag": "3533274d-9341-439a-8e8f-6ff119c5b8e3"}, {"server_uuid": "8d7e3d25-df60-4e49-9e80-4378cc82513f", "name": "network-vif-deleted", "tag": "29dc41a1-2bf2-42c4-a80a-e612ddfd232f"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:54.588608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.589173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.594567 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2a6b2b9c-aa5a-475b-9be8-f435f53b4d4f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522453546" status: 204 len: 0 microversion: 2.20 time: 0.043243 Aug 06 20:44:54.595145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 361/713] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Aug 6 20:44:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522453546 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:44:54.595318 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.619824 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] Creating event network-vif-deleted:3533274d-9341-439a-8e8f-6ff119c5b8e3 for instance 72752a0b-3b0b-428e-b578-4958b8a51a1b on hv-cinder-85199 Aug 06 20:44:54.620324 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] Creating event network-vif-deleted:29dc41a1-2bf2-42c4-a80a-e612ddfd232f for instance 8d7e3d25-df60-4e49-9e80-4378cc82513f on hv-cinder-85199 Aug 06 20:44:54.627038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-5f7e6ef7-961c-4b55-9681-d415794040ce req-5fa2d517-2417-4aed-b297-41ecc3050c30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062006 Aug 06 20:44:54.628131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 353/714] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:54.692064 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.692651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 8d7e3d25-df60-4e49-9e80-4378cc82513f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:54.698437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.698922 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.699431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.700141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.700759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.701012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.705775 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:54.716509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] HTTP exception thrown: Instance 8d7e3d25-df60-4e49-9e80-4378cc82513f could not be found. Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Request method failure captured: Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f HTTP/1.1 Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEELyIMRoITCHkzXMoIpQLRdf1oT0v4kcW1kHwW3jNckvrY8Gnnm13WP3_dMbBCCnEEg2PmjgEvBkRpH9ZsGtH-Zd_y0aP9fcqwz1Ovf-H3UHoSYeeQedQPM7aqmQc7DkUWdN3lqybAWABrP-R0V0IHLnyCM5FFNBBQMBtKE74M6EI Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:44:54.718380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 919c94bd42144c9b86fd9977e85b0762 Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 8d7e3d25-df60-4e49-9e80-4378cc82513f could not be found. Aug 06 20:44:54.719725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '8d7e3d25-df60-4e49-9e80-4378cc82513f'} Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d7e3d25-df60-4e49-9e80-4378cc82513f could not be found. Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:44:54.720435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d7e3d25-df60-4e49-9e80-4378cc82513f could not be found. Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d7e3d25-df60-4e49-9e80-4378cc82513f could not be found. Aug 06 20:44:54.721694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:44:54.722741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Returning 404 to user: Instance 8d7e3d25-df60-4e49-9e80-4378cc82513f could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:44:54.722741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-07aa9f5d-73ad-47b3-a3f4-0ef4f6e4f55d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f" status: 404 len: 111 microversion: 2.1 time: 0.031896 Aug 06 20:44:54.722741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 362/715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:54 2022] GET /compute/v2.1/servers/8d7e3d25-df60-4e49-9e80-4378cc82513f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:44:54.732979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.733963 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:54.740814 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.741646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.742310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.743228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.743952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.745167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.774372 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:44:54.863170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-27fba96c-8bb4-4522-92a5-894903c49364 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 204 len: 0 microversion: 2.1 time: 0.135437 Aug 06 20:44:54.863915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 354/716] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:44:54 2022] DELETE /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:44:54.872647 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:54.873263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:54.879226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.879735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.880170 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:54.881063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:54.881524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:54.881956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:55.105131 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:55.105826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-18c2db86-1a6a-48fb-87fc-9afd47a365f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: .version_select at 0x7fba95ec5ca0>, body: {"keypair": {"name": "tempest-keypair-403535545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAghLkPF0SrePA1mH2T2lqg7YmvGQOmAdUbZWxDw8UcEUgSfCeNhJmFsGV66V/0Pd2vIVfLtSYzRCSh2qMLL2q9MXoSNO606d7NXYj2pRh7K9rO5/P/p1dxGDRQybYKx2w=="}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:55.113111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e2cf3fe9-57df-40c7-a303-16fd353bf1c7 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.245094 Aug 06 20:44:55.114503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 363/717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:54 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:55.122718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-18c2db86-1a6a-48fb-87fc-9afd47a365f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for project 9193df5e4d39448c947cfbb3139306bf. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:44:55.126670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-18c2db86-1a6a-48fb-87fc-9afd47a365f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for user 86090cd4247d4d598eb1976f4224b4f3 and project 9193df5e4d39448c947cfbb3139306bf. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:44:55.149098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-18c2db86-1a6a-48fb-87fc-9afd47a365f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047745 Aug 06 20:44:55.149696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 355/718] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:44:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:44:55.389773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-abe44ee6-8d28-437f-aa90-1e30da6f28a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'create', calling method: .version_select at 0x7fba95875790>, body: {"keypair": {"name": "tempest-keypair-628378290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqribdwpvHVG5AITR1/+n5VObam9ce8zjKJONPMnYU46hjW0WR3MDblFtOlDGy4vfSa7KjWOlcz1GhIX55y2WSiSPE9DoIjmT4xorsdm9aWb5PTtPNrV4H3GX/nba2SFg=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:55.407347 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-abe44ee6-8d28-437f-aa90-1e30da6f28a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:44:55.411126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-abe44ee6-8d28-437f-aa90-1e30da6f28a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for user 8dcb94f981244d569f1dd791a4d911ac and project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:44:55.436263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-abe44ee6-8d28-437f-aa90-1e30da6f28a1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050831 Aug 06 20:44:55.437019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 364/719] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Aug 6 20:44:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 06 20:44:56.134947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:56.135722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:56.143469 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:56.144090 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:56.145368 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:56.146145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:56.146678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:56.147407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:56.411742 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:56.419532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b34f8b7e-7563-45e4-a0f7-e9cbc7c0616c tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.288559 Aug 06 20:44:56.420092 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 356/720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:56 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:57.245236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1523757080", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "978da649-b201-4052-9259-dabfd9448731"}], "security_groups": [{"name": "tempest-securitygroup--885832359"}], "key_name": "tempest-keypair-403535545", "user_data": "}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:57.440955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:57.441560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:57.446582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] validate_networks() for [('978da649-b201-4052-9259-dabfd9448731', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:44:57.448785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:57.449286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:57.449722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:57.450692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:57.451206 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:57.451657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:57.873554 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:57.881196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-23fc3f9e-6f53-496e-b6ba-b9f94d3a4583 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1520 microversion: 2.1 time: 0.444145 Aug 06 20:44:57.881857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 357/721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:57 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:44:58.004817 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-985559757", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c6ef45e-275a-4453-acaf-29d4869697fb"}], "security_groups": [{"name": "tempest-securitygroup--1641342058"}], "key_name": "tempest-keypair-628378290", "user_data": "}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:58.165202 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] validate_networks() for [('9c6ef45e-275a-4453-acaf-29d4869697fb', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:44:58.408681 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:44:58.409287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:44:58.409893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:44:58.410372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:44:58.410925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:44:58.424857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.425355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.425816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.426735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.427212 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.427677 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.451003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for project 9193df5e4d39448c947cfbb3139306bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:44:58.455372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Getting quotas for user 86090cd4247d4d598eb1976f4224b4f3 and project 9193df5e4d39448c947cfbb3139306bf. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:44:58.468674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:44:58.470951 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:44:58.525079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-24c38cac-e92c-44b0-bdc5-71c9d126ae14 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.284470 Aug 06 20:44:58.533982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 365/722] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:44:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:44:58.539205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-6110d24d-ceab-4764-a0f0-698df430553e req-30c5d38c-d50b-4672-9507-5f793732a910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d", "name": "network-vif-deleted", "tag": "6fce6b6f-cd73-4f5c-9c57-051221c987e2"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:44:58.550638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-6110d24d-ceab-4764-a0f0-698df430553e req-30c5d38c-d50b-4672-9507-5f793732a910 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.551119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-6110d24d-ceab-4764-a0f0-698df430553e req-30c5d38c-d50b-4672-9507-5f793732a910 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.551590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-6110d24d-ceab-4764-a0f0-698df430553e req-30c5d38c-d50b-4672-9507-5f793732a910 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-6110d24d-ceab-4764-a0f0-698df430553e req-30c5d38c-d50b-4672-9507-5f793732a910 service nova] Creating event network-vif-deleted:6fce6b6f-cd73-4f5c-9c57-051221c987e2 for instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d on hv-cinder-85199 Aug 06 20:44:58.569422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-6110d24d-ceab-4764-a0f0-698df430553e req-30c5d38c-d50b-4672-9507-5f793732a910 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 Aug 06 20:44:58.570366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 366/723] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:44:58.575902 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bb08d41d-daca-4ed1-a1be-865591329490 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:58.576601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bb08d41d-daca-4ed1-a1be-865591329490 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:58.666663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bb08d41d-daca-4ed1-a1be-865591329490 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:58.675651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bb08d41d-daca-4ed1-a1be-865591329490 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1237 microversion: 2.1 time: 0.103384 Aug 06 20:44:58.676459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 367/724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:58 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:58.771593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:44:58.772067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:44:58.772469 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:44:58.773058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:44:58.773658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:44:58.784287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.785406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.786010 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.787171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.787678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.788302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.811589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:44:58.816003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Getting quotas for user 8dcb94f981244d569f1dd791a4d911ac and project a301a9f453aa435dbd07ff1d074e5a08. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:44:58.818850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:58.830412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:44:58.832748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:44:58.886527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fdaab834-840e-4b28-99a6-193fc578a67f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.886252 Aug 06 20:44:58.891404 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 358/725] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Aug 6 20:44:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 20:44:58.898118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-761b0a7e-07ac-4d29-97eb-f58e34cc92ef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:58.898820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-761b0a7e-07ac-4d29-97eb-f58e34cc92ef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:58.905381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:58.906254 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:58.913938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.914698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.915551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.920441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.921310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.921770 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.962763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-761b0a7e-07ac-4d29-97eb-f58e34cc92ef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:58.972259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-761b0a7e-07ac-4d29-97eb-f58e34cc92ef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:58.975002 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-761b0a7e-07ac-4d29-97eb-f58e34cc92ef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:58.976905 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-761b0a7e-07ac-4d29-97eb-f58e34cc92ef tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1280 microversion: 2.20 time: 0.082100 Aug 06 20:44:58.977515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:58.978151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:58.978320 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 368/726] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:58 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:44:58.978760 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:58.979338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lazy-loading 'fault' on Instance uuid 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:44:59.031228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '919c94bd42144c9b86fd9977e85b0762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e2bf24478c34b9088fb7cfaa0affb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:59.038672 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4ba3f5a1-8537-4192-9c5f-4b05cffd3c5d tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 200 len: 1311 microversion: 2.1 time: 0.138198 Aug 06 20:44:59.039252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 359/727] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:58 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:44:59.696298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:44:59.697666 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:44:59.704496 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:59.704977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:59.705407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:59.706100 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:44:59.706553 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:44:59.706977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:44:59.814026 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:44:59.821691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6fc7320e-c338-4990-a6c7-c463236e46d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1297 microversion: 2.1 time: 0.129507 Aug 06 20:44:59.822263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 369/728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:44:59 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:00.001383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:00.001993 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:00.008359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:00.008844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:00.009278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:00.009990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:00.010445 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:00.010869 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:00.059935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:00.060548 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] [instance: 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:00.066641 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:00.067139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:00.067595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:00.068295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:00.068760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:00.069190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:00.083866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] HTTP exception thrown: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d could not be found. Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Request method failure captured: Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d HTTP/1.1 Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEELyIMRoITCHkzXMoIpQLRdf1oT0v4kcW1kHwW3jNckvrY8Gnnm13WP3_dMbBCCnEEg2PmjgEvBkRpH9ZsGtH-Zd_y0aP9fcqwz1Ovf-H3UHoSYeeQedQPM7aqmQc7DkUWdN3lqybAWABrP-R0V0IHLnyCM5FFNBBQMBtKE74M6EI Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:45:00.085967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e2bf24478c34b9088fb7cfaa0affb97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 7e2bf24478c34b9088fb7cfaa0affb97 Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1068192345 Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 919c94bd42144c9b86fd9977e85b0762 Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1068192345-project Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d could not be found. Aug 06 20:45:00.087324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d'} Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d could not be found. Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:00.088034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d could not be found. Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d could not be found. Aug 06 20:45:00.089464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:45:00.091084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] Returning 404 to user: Instance 26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:00.091084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1d6edb09-7cf4-41cc-8e50-58f48f58a0e0 tempest-ServerRescueNegativeTestJSON-1068192345 tempest-ServerRescueNegativeTestJSON-1068192345-project] 10.222.0.17 "GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d" status: 404 len: 111 microversion: 2.1 time: 0.031328 Aug 06 20:45:00.091084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 370/729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:00 2022] GET /compute/v2.1/servers/26ce8e6f-11e1-486b-99a1-f0c53b0f9d6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:45:00.095423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:00.103853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:00.105351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:00.106646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dd794907-db3b-4f81-9ed6-9ea5b1d17321 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1332 microversion: 2.20 time: 0.109130 Aug 06 20:45:00.107200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 360/730] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:44:59 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:00.843523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:00.844138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:00.850504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:00.850994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:00.851461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:00.852161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:00.852612 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:00.853034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:00.958666 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:00.967392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c2d741b2-c182-422d-85bf-e51be95bc610 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1295 microversion: 2.1 time: 0.128054 Aug 06 20:45:00.968218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 371/731] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:00 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:01.129928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:01.130816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:01.138860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:01.139735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:01.140281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:01.141215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:01.141768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:01.142321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:01.237864 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:01.259441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:01.261297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:01.263778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b5721344-5cdf-4ed9-955c-494a1333ba98 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1338 microversion: 2.20 time: 0.138107 Aug 06 20:45:01.267325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 361/732] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:01 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1338 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:01.988783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:01.989405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:02.001420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:02.001923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:02.002368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:02.003079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:02.003572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:02.016094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:02.286159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:02.287500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:02.294825 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:02.295609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:02.296198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:02.297066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:02.297701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:02.298277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:02.437546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:02.454047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-023f8361-c786-4255-b3da-3cfba7b390d9 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.468878 Aug 06 20:45:02.455117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 372/733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:01 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:02.619823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:02.629906 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:02.631782 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:02.633588 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a8a27dc9-1238-4e0e-b8bb-7c5ef02fb7ad tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.350652 Aug 06 20:45:02.634157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 362/734] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:02 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:03.108216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-e872853b-f78e-41e9-92aa-70bd6f35bb82 req-ff9c00ea-c345-4d6f-94c2-7a3c8b5af5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845436a8-214f-479a-8b98-6d7d1dd197cb", "tag": "e18a9e09-77ea-4980-8e71-9106895598be"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:03.124959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e872853b-f78e-41e9-92aa-70bd6f35bb82 req-ff9c00ea-c345-4d6f-94c2-7a3c8b5af5ab service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:03.125669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e872853b-f78e-41e9-92aa-70bd6f35bb82 req-ff9c00ea-c345-4d6f-94c2-7a3c8b5af5ab service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:03.126111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e872853b-f78e-41e9-92aa-70bd6f35bb82 req-ff9c00ea-c345-4d6f-94c2-7a3c8b5af5ab service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:03.137726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-e872853b-f78e-41e9-92aa-70bd6f35bb82 req-ff9c00ea-c345-4d6f-94c2-7a3c8b5af5ab service nova] Creating event network-changed:e18a9e09-77ea-4980-8e71-9106895598be for instance 845436a8-214f-479a-8b98-6d7d1dd197cb on hv-cinder-85199 Aug 06 20:45:03.143839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-e872853b-f78e-41e9-92aa-70bd6f35bb82 req-ff9c00ea-c345-4d6f-94c2-7a3c8b5af5ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049454 Aug 06 20:45:03.144909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 373/735] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:03.478535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:03.480339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:03.491292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:03.492473 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:03.493119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:03.494265 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:03.495219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:03.495828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:03.660654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:03.661355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:03.674505 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:03.675982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:03.676436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:03.677184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:03.677641 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:03.678067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:04.081603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:04.091729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-494217d3-7771-4b11-8c7b-0264805fa821 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.620305 Aug 06 20:45:04.092399 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 363/736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:03 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:45:04.122988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:04.133318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:04.135196 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:04.136767 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e9da902b-dc01-44e4-a4d4-6bee88832f73 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.483408 Aug 06 20:45:04.137531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 374/737] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:03 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:05.112372 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:05.112989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:05.119528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:05.120014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:05.120453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:05.121194 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:05.121651 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:05.122084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:05.159645 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:05.160330 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:05.163930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:05.167552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:05.168095 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:05.168529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:05.169465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:05.169917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:05.170552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:05.303909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:05.306419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:05.313057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1052d910-f8dd-4bbb-b368-89d86ce1b008 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.204425 Aug 06 20:45:05.314126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 364/738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:05 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:05.318928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-da4ecc31-41f8-4c01-bd75-50bfeead84b0 req-c26f56b0-24df-4a77-a546-7f358659652e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:05.329161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-da4ecc31-41f8-4c01-bd75-50bfeead84b0 req-c26f56b0-24df-4a77-a546-7f358659652e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:05.329597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-da4ecc31-41f8-4c01-bd75-50bfeead84b0 req-c26f56b0-24df-4a77-a546-7f358659652e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:05.330036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-da4ecc31-41f8-4c01-bd75-50bfeead84b0 req-c26f56b0-24df-4a77-a546-7f358659652e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:05.343063 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-da4ecc31-41f8-4c01-bd75-50bfeead84b0 req-c26f56b0-24df-4a77-a546-7f358659652e service nova] Creating event network-changed:6fd7b112-713c-4645-9ef1-dadf3f856ec4 for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 on hv-cinder-85199 Aug 06 20:45:05.344976 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:05.348073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-da4ecc31-41f8-4c01-bd75-50bfeead84b0 req-c26f56b0-24df-4a77-a546-7f358659652e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Aug 06 20:45:05.348709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 365/739] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:05.353862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:05.355450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:05.356560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-acd13368-19de-4ab8-93b7-2cb56c0b51fb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.201528 Aug 06 20:45:05.357112 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 375/740] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:05 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:06.335784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:06.336476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:06.342524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:06.343002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:06.343462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:06.344150 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:06.344600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:06.345019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:06.377945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:06.378660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:06.385083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:06.385642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:06.386148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:06.387633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:06.388184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:06.388616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:06.525785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:06.533344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dcf093e9-4554-4008-ab02-f1f5442f93f6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.202500 Aug 06 20:45:06.533915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 366/741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:06 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:06.552269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:06.560616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:06.562114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:06.563218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-00130510-1778-43f0-bf06-9ecd2835a76f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.189147 Aug 06 20:45:06.563794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 376/742] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:06 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:07.553816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:07.554362 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:07.560754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:07.561236 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:07.561665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:07.562347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:07.562797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:07.563217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:07.587155 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:07.588036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:07.594697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:07.595180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:07.596178 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:07.596890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:07.597348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:07.597931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:07.741833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:07.749605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d317c5b4-9168-4d60-9e71-63be63336b3b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.199684 Aug 06 20:45:07.750407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 367/743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:07 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:07.768758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:07.776742 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:07.778228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:07.779352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-60b1800c-20a6-4662-bf35-3ee0bb29fc6f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.198504 Aug 06 20:45:07.779911 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 377/744] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:07 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:08.769972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:08.771213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:08.779126 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:08.779663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:08.780277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:08.781109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:08.781559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:08.782140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:08.799461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:08.802287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:08.802894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:08.806005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:08.811790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:08.812585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:08.813094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:08.813860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:08.814843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:08.815388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:08.826042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=10 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:08.968092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=14 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:09.086663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:09.090187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:09.094200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0967bf0d-6852-4eaf-aee2-20558e0eb406 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.328104 Aug 06 20:45:09.094779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 368/745] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:08 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:09.098077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:09.099627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:09.100843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f5412e0a-1ef5-4439-8f2a-5f20907c6a41 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.303151 Aug 06 20:45:09.101400 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 378/746] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:08 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:10.116174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:10.116780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:10.122352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:10.122997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:10.124436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:10.124939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:10.125375 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:10.126119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:10.126573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:10.127045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:10.129474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:10.129962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:10.130414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:10.131118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:10.131762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:10.132343 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:10.442823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:10.446865 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:10.451545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:10.453088 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:10.454196 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9e39921e-b5d7-4459-a67c-513e57514502 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.335884 Aug 06 20:45:10.454758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 379/747] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:10 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:10.454896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-719009bb-5fb2-4c7c-b247-fbdc6bfd6a97 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.342545 Aug 06 20:45:10.455473 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 369/748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:10 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:11.475872 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:11.476404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:11.476502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:11.477098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:11.483530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:11.483676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:11.484020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:11.484125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:11.484460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:11.484615 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:11.485180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:11.485292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:11.485640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:11.485766 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:11.486063 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:11.486165 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:11.676374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:11.682910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:11.685057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:11.686596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:11.687738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1e6e9e89-b721-44d4-8876-15dee9ccc997 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.215064 Aug 06 20:45:11.688303 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 370/749] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:11 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:11.690726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0abf66e7-50f8-48f9-9c40-707068ea53c2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.218847 Aug 06 20:45:11.691296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 380/750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:11 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:45:12.710839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:12.711507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:12.711906 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:12.712010 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:12.717543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:12.717869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:12.718027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:12.718348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:12.718448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:12.718779 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:12.719138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:12.719491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:12.719625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:12.719940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:12.720045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:12.720359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:12.905252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:12.911940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:12.912841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-30921be0-6c6c-4a8e-81bb-4c0c2a62115a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.206034 Aug 06 20:45:12.914007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 371/751] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:12 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:12.920949 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:12.923381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:12.923822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4417e548-1c09-4d92-ac6e-750da4a90841 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.217159 Aug 06 20:45:12.929649 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 381/752] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:12 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:13.934507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:13.935228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:13.943527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:13.944259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:13.944705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:13.945446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:13.945905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:13.946335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:13.946614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:13.947218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:13.954830 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:13.955450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:13.956253 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:13.957091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:13.957614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:13.958384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:14.153446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:14.160228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:14.169252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f20e1f84-9516-4d73-a8d2-619bbed8dded tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.239125 Aug 06 20:45:14.169744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:14.170112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 372/753] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:13 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:14.172237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:14.174271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-cc22be12-253f-4ac8-b572-2b960ed5d3e1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.231305 Aug 06 20:45:14.175366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 382/754] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:13 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:14.765218 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-b2d0d561-fae6-487d-827a-9e298a40ae1c req-471a56c9-9650-4988-90a1-42099f05e3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845436a8-214f-479a-8b98-6d7d1dd197cb", "name": "network-vif-plugged", "status": "completed", "tag": "e18a9e09-77ea-4980-8e71-9106895598be"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:14.775583 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-b2d0d561-fae6-487d-827a-9e298a40ae1c req-471a56c9-9650-4988-90a1-42099f05e3d3 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:14.776165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-b2d0d561-fae6-487d-827a-9e298a40ae1c req-471a56c9-9650-4988-90a1-42099f05e3d3 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:14.776655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-b2d0d561-fae6-487d-827a-9e298a40ae1c req-471a56c9-9650-4988-90a1-42099f05e3d3 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:14.789753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-b2d0d561-fae6-487d-827a-9e298a40ae1c req-471a56c9-9650-4988-90a1-42099f05e3d3 service nova] Creating event network-vif-plugged:e18a9e09-77ea-4980-8e71-9106895598be for instance 845436a8-214f-479a-8b98-6d7d1dd197cb on hv-cinder-85199 Aug 06 20:45:14.795154 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-b2d0d561-fae6-487d-827a-9e298a40ae1c req-471a56c9-9650-4988-90a1-42099f05e3d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Aug 06 20:45:14.795962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 373/755] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:15.190128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:15.190735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:15.197170 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:15.197660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:15.198092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:15.198430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:15.198843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:15.199130 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:15.199628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:15.200296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:15.205864 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:15.206349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:15.206788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:15.207542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:15.208030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:15.208456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:15.407779 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:15.409235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:15.416103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c2e4afa4-39d1-420d-93e9-e96650b2d2af tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.229664 Aug 06 20:45:15.417025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 383/756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:15 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:15.434340 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:15.436055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:15.437438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6c9081c4-8efa-4e36-b452-00987edd4425 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.243016 Aug 06 20:45:15.438164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 374/757] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:15 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:15.520228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:15.520728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:15.526658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:15.527706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:15.528144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:15.528840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:15.529297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:15.529726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:15.555371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f5066196-452a-4ce1-8d8d-9862a4741a4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/ips" status: 200 len: 149 microversion: 2.1 time: 0.042395 Aug 06 20:45:15.555955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 384/758] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:45:15 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:16.440060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:16.440676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:16.447024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.447546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.447985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:16.448682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.449132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.449561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:16.459191 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:16.460868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:16.467461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.467955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.468395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:16.469090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.469546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.469968 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:16.491616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:16.654481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:16.657561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:16.663764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:16.665460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:16.665968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a7db2cbd-c802-4165-bf23-9d7f2e9e6fbf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1362 microversion: 2.1 time: 0.229711 Aug 06 20:45:16.666863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 375/759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:16 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:16.679385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-46c09989-cc9e-47f2-b017-0d9b683db204 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.211258 Aug 06 20:45:16.680222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 385/760] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:16 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:16.810909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-a3bd9ea9-2d38-41ca-b8c9-3c4b68a879b3 req-80539b46-f65d-4e77-9581-9529409dd4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "name": "network-vif-plugged", "status": "completed", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:16.820855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-a3bd9ea9-2d38-41ca-b8c9-3c4b68a879b3 req-80539b46-f65d-4e77-9581-9529409dd4ee service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.821329 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-a3bd9ea9-2d38-41ca-b8c9-3c4b68a879b3 req-80539b46-f65d-4e77-9581-9529409dd4ee service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.821758 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-a3bd9ea9-2d38-41ca-b8c9-3c4b68a879b3 req-80539b46-f65d-4e77-9581-9529409dd4ee service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:16.838101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-a3bd9ea9-2d38-41ca-b8c9-3c4b68a879b3 req-80539b46-f65d-4e77-9581-9529409dd4ee service nova] Creating event network-vif-plugged:6fd7b112-713c-4645-9ef1-dadf3f856ec4 for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 on hv-cinder-85199 Aug 06 20:45:16.844436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-a3bd9ea9-2d38-41ca-b8c9-3c4b68a879b3 req-80539b46-f65d-4e77-9581-9529409dd4ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038338 Aug 06 20:45:16.845027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 376/761] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:16.899751 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51c05fc8-d8ea-402c-9365-814eb738261d"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:16.902174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:16.908584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.909144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.909679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:16.910434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:16.910890 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:16.911342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:17.447296 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7716463d-6ca0-45b7-b7b3-c7f8f51bf530 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551532 Aug 06 20:45:17.447978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 386/762] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:45:16 2022] POST /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:45:17.687416 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:17.688120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:17.694705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:17.695191 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:17.695658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:17.696348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:17.696808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:17.697236 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:17.704009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:17.704696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:17.711042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:17.711550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:17.711985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:17.712669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:17.713116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:17.713534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:17.891123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:17.899324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:17.899614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-515d44c3-078f-43fc-bb11-8d8dad486a70 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1548 microversion: 2.1 time: 0.216151 Aug 06 20:45:17.900196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 377/763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:17 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:17.908905 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:17.910478 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:17.911754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-63021680-4298-427b-bfd1-c212734ac4b2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1406 microversion: 2.20 time: 0.212373 Aug 06 20:45:17.912374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 387/764] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:17 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:45:17.920300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:17.920884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:17.926742 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:17.927227 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:17.927703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:17.928394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:17.928856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:17.929285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:18.005637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0454c06d-637b-4c3b-9f9d-897374796b74 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089020 Aug 06 20:45:18.006230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 378/765] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:45:17 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:45:18.934610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:18.935323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:18.938557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-459c02e4-639f-439e-b5e4-c03e497da07e req-f41d4aee-6914-4c2e-a222-c0a744ede936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "845436a8-214f-479a-8b98-6d7d1dd197cb", "tag": "e18a9e09-77ea-4980-8e71-9106895598be"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:18.941944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:18.942628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:18.943063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:18.943783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:18.944257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:18.944655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:18.952603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-459c02e4-639f-439e-b5e4-c03e497da07e req-f41d4aee-6914-4c2e-a222-c0a744ede936 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:18.953219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-459c02e4-639f-439e-b5e4-c03e497da07e req-f41d4aee-6914-4c2e-a222-c0a744ede936 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:18.953840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-459c02e4-639f-439e-b5e4-c03e497da07e req-f41d4aee-6914-4c2e-a222-c0a744ede936 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:18.968513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-459c02e4-639f-439e-b5e4-c03e497da07e req-f41d4aee-6914-4c2e-a222-c0a744ede936 service nova] Creating event network-changed:e18a9e09-77ea-4980-8e71-9106895598be for instance 845436a8-214f-479a-8b98-6d7d1dd197cb on hv-cinder-85199 Aug 06 20:45:18.973848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-459c02e4-639f-439e-b5e4-c03e497da07e req-f41d4aee-6914-4c2e-a222-c0a744ede936 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040589 Aug 06 20:45:18.974523 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 379/766] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:45:19.085746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:19.094254 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:19.095781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:19.096970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-be5150ba-0eae-4922-87a7-9256ddeec5fc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1597 microversion: 2.20 time: 0.167184 Aug 06 20:45:19.097533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 388/767] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:45:18 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:45:19.119882 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:19.120468 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:19.127041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:19.127569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:19.128013 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:19.128720 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:19.129178 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:19.129606 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:19.207038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-04a84923-f0c7-44d8-84cd-7de40d119286 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091411 Aug 06 20:45:19.207697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 380/768] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Aug 6 20:45:19 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:45:20.988989 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-2d1e644a-5fd3-40cc-b2be-da6f6b2e6aa2 req-45b9b997-d233-466a-97c3-4a847a22a90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:21.007918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-2d1e644a-5fd3-40cc-b2be-da6f6b2e6aa2 req-45b9b997-d233-466a-97c3-4a847a22a90c service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:21.008406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-2d1e644a-5fd3-40cc-b2be-da6f6b2e6aa2 req-45b9b997-d233-466a-97c3-4a847a22a90c service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:21.008837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-2d1e644a-5fd3-40cc-b2be-da6f6b2e6aa2 req-45b9b997-d233-466a-97c3-4a847a22a90c service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:21.025287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-2d1e644a-5fd3-40cc-b2be-da6f6b2e6aa2 req-45b9b997-d233-466a-97c3-4a847a22a90c service nova] Creating event network-changed:6fd7b112-713c-4645-9ef1-dadf3f856ec4 for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 on hv-cinder-85199 Aug 06 20:45:21.039302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-2d1e644a-5fd3-40cc-b2be-da6f6b2e6aa2 req-45b9b997-d233-466a-97c3-4a847a22a90c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053745 Aug 06 20:45:21.039925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 389/769] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:26.111748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51c05fc8-d8ea-402c-9365-814eb738261d"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:26.114056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:26.120111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:26.121052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:26.121491 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:26.122180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:26.122633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:26.123058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:26.205632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Invalid volume: volume 51c05fc8-d8ea-402c-9365-814eb738261d is already attached to instances: edade601-e01d-4bf7-ab7e-f9f48c518314 Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: POST /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments HTTP/1.1 Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 74 Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:45:26.207485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {"volumeAttachment": {"volumeId": "51c05fc8-d8ea-402c-9365-814eb738261d"}} Aug 06 20:45:26.209077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Invalid volume: volume 51c05fc8-d8ea-402c-9365-814eb738261d is already attached to instances: edade601-e01d-4bf7-ab7e-f9f48c518314 Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'server_id': 'edade601-e01d-4bf7-ab7e-f9f48c518314', 'body': {'volumeAttachment': {'volumeId': '51c05fc8-d8ea-402c-9365-814eb738261d'}}} Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 51c05fc8-d8ea-402c-9365-814eb738261d is already attached to instances: edade601-e01d-4bf7-ab7e-f9f48c518314 Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:26.210221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 51c05fc8-d8ea-402c-9365-814eb738261d is already attached to instances: edade601-e01d-4bf7-ab7e-f9f48c518314 Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:26.211527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 51c05fc8-d8ea-402c-9365-814eb738261d is already attached to instances: edade601-e01d-4bf7-ab7e-f9f48c518314 Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 400 to user: Invalid volume: volume 51c05fc8-d8ea-402c-9365-814eb738261d is already attached to instances: edade601-e01d-4bf7-ab7e-f9f48c518314 {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8765682e-9a55-4ed2-b4c0-9667f310f79e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103521 Aug 06 20:45:26.212953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 381/770] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:45:26 2022] POST /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 20:45:26.280624 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:26.281200 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:26.287372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:26.287859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:26.288288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:26.288977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:26.289423 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:26.289840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:26.373241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'services' on Instance uuid edade601-e01d-4bf7-ab7e-f9f48c518314 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:45:26.449326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-20fb5d3b-bd0d-4f3c-a82a-e17495ecb53e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments/51c05fc8-d8ea-402c-9365-814eb738261d" status: 202 len: 0 microversion: 2.1 time: 0.173393 Aug 06 20:45:26.450785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 390/771] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:45:26 2022] DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments/51c05fc8-d8ea-402c-9365-814eb738261d => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:45:26.458569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:26.461111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:26.468260 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:26.469245 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:26.469618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:26.470734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:26.471512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:26.472230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:26.507299 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-41fe74dd-07b1-44f6-81f3-ad026f915081 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052824 Aug 06 20:45:26.507854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 382/772] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:45:26 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:45:27.521285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:27.523678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:27.530215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:27.530692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:27.531123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:27.531833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:27.532284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:27.532724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:27.563402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7c1f84d1-2f55-4bb1-a84d-1b4dc9f89095 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046387 Aug 06 20:45:27.564279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 391/773] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:45:27 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:45:27.624514 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:27.625015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:27.631453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:27.631943 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:27.632381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:27.633079 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:27.633532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:27.633957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:27.660461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:45:27.694112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:27.737281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-85a7e1a2-6ef9-4fca-a74f-adcdd2fff182 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 204 len: 0 microversion: 2.1 time: 0.116825 Aug 06 20:45:27.738040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 383/774] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:45:27 2022] DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:45:27.746470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:27.747111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:27.752930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:27.753413 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:27.753855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:27.754534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:27.754988 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:27.755483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:27.887909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:27.895568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1c069a33-058f-411c-83c7-eaad2b5b2459 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.153424 Aug 06 20:45:27.896136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 392/775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:27 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:28.916851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:28.918094 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:28.920484 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:28.926163 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:28.926662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:28.927107 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:28.927830 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:28.928286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:28.928712 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:29.060197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:29.067638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0ed85cf3-1066-40ee-8869-3db114dba25d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.155066 Aug 06 20:45:29.068202 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 384/776] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:28 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:30.088819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:30.089989 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:30.096540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:30.097023 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:30.097460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:30.098147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:30.098607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:30.099031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:30.223912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:30.231527 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2bc97800-3686-460c-a2b0-82cf5e4931d4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.146764 Aug 06 20:45:30.232094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 393/777] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:30 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:31.253055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:31.253663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:31.260384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:31.260861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:31.261288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:31.261977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:31.262423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:31.262840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:31.390967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:31.398935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-37cc563c-48bc-4c0c-84b5-1c632bcd34c1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.150154 Aug 06 20:45:31.399522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 385/778] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:31 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:32.421269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:32.421953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:32.428397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:32.428912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:32.429351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:32.430075 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:32.430533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:32.430959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:32.558539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:32.566086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b08c27d5-7cf9-4216-bca9-5969ed037f68 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.149619 Aug 06 20:45:32.566750 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 394/779] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:32 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:33.587313 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:33.587928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:33.594868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:33.595383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:33.595830 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:33.596528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:33.596985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:33.597407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:33.727711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:33.735296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b6df59de-4688-472d-a239-0772fd7653e8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.152091 Aug 06 20:45:33.735864 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 386/780] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:33 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:34.756072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:34.756673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:34.762961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:34.763479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:34.763909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:34.764636 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:34.765036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:34.765455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:34.891625 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:34.898892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9d6aac21-b67c-466c-91a9-258cd8d252b8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.146606 Aug 06 20:45:34.899484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 395/781] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:34 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:35.919944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:35.920551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:35.926949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:35.927470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:35.927907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:35.928597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:35.929050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:35.929476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:36.062525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:36.071196 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c184a1f0-2861-44b9-a76b-b7fec6aede74 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.154934 Aug 06 20:45:36.071789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 387/782] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:35 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:37.092367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:37.092977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:37.095409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=41 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:37.100644 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:37.101137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:37.101595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:37.102288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:37.102744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:37.103169 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:37.487476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:37.495078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-253954ba-3d9b-48d4-8eef-df9dbe24e320 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1681 microversion: 2.1 time: 0.406529 Aug 06 20:45:37.495690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 396/783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:37 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:38.313777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-ccd8df2a-9e7d-493c-a197-91eda952c782 req-a8c832f0-fa3c-4285-b7fd-439e7bc3aa98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edade601-e01d-4bf7-ab7e-f9f48c518314", "name": "network-vif-deleted", "tag": "6962f219-ff80-49d1-bfc9-42a98f3f6cef"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:38.324848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-ccd8df2a-9e7d-493c-a197-91eda952c782 req-a8c832f0-fa3c-4285-b7fd-439e7bc3aa98 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:38.325470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-ccd8df2a-9e7d-493c-a197-91eda952c782 req-a8c832f0-fa3c-4285-b7fd-439e7bc3aa98 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:38.325964 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-ccd8df2a-9e7d-493c-a197-91eda952c782 req-a8c832f0-fa3c-4285-b7fd-439e7bc3aa98 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:38.337281 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-ccd8df2a-9e7d-493c-a197-91eda952c782 req-a8c832f0-fa3c-4285-b7fd-439e7bc3aa98 service nova] Creating event network-vif-deleted:6962f219-ff80-49d1-bfc9-42a98f3f6cef for instance edade601-e01d-4bf7-ab7e-f9f48c518314 on hv-cinder-85199 Aug 06 20:45:38.342752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-ccd8df2a-9e7d-493c-a197-91eda952c782 req-a8c832f0-fa3c-4285-b7fd-439e7bc3aa98 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033352 Aug 06 20:45:38.343931 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 388/784] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:38.516657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:38.517547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:38.523978 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:38.524727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:38.524912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:38.525842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:38.526955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:38.528020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:38.585579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:38.586401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:38.587015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:38.587659 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'fault' on Instance uuid edade601-e01d-4bf7-ab7e-f9f48c518314 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:45:38.633502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:38.642810 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-83ea0131-3c91-4291-a6c9-86e4af486c3b tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 200 len: 1331 microversion: 2.1 time: 0.130218 Aug 06 20:45:38.643673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 397/785] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:38 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:39.667723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:39.668420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:39.675000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:39.675514 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:39.675952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:39.676702 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:39.677147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:39.677569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:39.691548 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 HTTP/1.1 Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:45:39.693208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:45:39.694667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': 'edade601-e01d-4bf7-ab7e-f9f48c518314'} Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:45:39.695762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:45:39.697515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:45:39.699160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:45:39.699160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-682db828-7bef-4d49-a5c8-a7f1823bc688 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 404 len: 111 microversion: 2.1 time: 0.031705 Aug 06 20:45:39.699160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 389/786] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:39 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:45:39.705464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0d84a123-76d1-491f-89ca-faff0c8a84ea tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '.version_select at 0x7fba9a7ab4c0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:39.724070 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0d84a123-76d1-491f-89ca-faff0c8a84ea tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269510951" status: 202 len: 0 microversion: 2.1 time: 0.023721 Aug 06 20:45:39.724746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 398/787] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 20:45:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269510951 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:45:40.325692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9910dfd5-cb91-44f6-96f7-37d7e1895cec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: .version_select at 0x7fba95ec55e0>, body: {"keypair": {"name": "tempest-keypair-1435864883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC6rDKWgJcy3VV9P42G24BdmrJSztq5uubqDFf4wc7vZcLbBVRWnssH23BAyCHDjD4cXHiIDbwCJBxakpYI3tcRbQDlrqG6GO+d+rmK1PX29kcHhnpjsCfN/SPRq0eZvQ=="}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:40.341499 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-9910dfd5-cb91-44f6-96f7-37d7e1895cec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:45:40.346105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-9910dfd5-cb91-44f6-96f7-37d7e1895cec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'key_pairs'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:45:40.368448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9910dfd5-cb91-44f6-96f7-37d7e1895cec tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046599 Aug 06 20:45:40.369134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 390/788] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:45:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:41.618809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1832697287", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "204900d1-dea4-474e-a19d-da292c4d4d6a"}], "security_groups": [{"name": "tempest-securitygroup--1728286619"}], "key_name": "tempest-keypair-1435864883", "user_data": "}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:41.723919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] validate_networks() for [('204900d1-dea4-474e-a19d-da292c4d4d6a', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:45:42.119454 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:45:42.119883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:45:42.120360 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:45:42.120837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:45:42.121280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:45:42.130158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:42.130639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:42.131081 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:42.131850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:42.132307 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:42.132731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:42.149733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:45:42.153655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Getting quotas for user 28a58d55f9cc42c7a041884eee0ea248 and project 2a036d3083bb4055a3aed77a698b2c3b. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:45:42.165293 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:45:42.167550 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:45:42.212268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7d13904c-e4d3-45ee-b66e-c69570f5e411 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598316 Aug 06 20:45:42.212840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 399/789] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:45:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:45:42.224204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9e775bba-69c3-4f05-a09e-9a1dc2c6a51e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:42.224805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9e775bba-69c3-4f05-a09e-9a1dc2c6a51e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:42.284023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9e775bba-69c3-4f05-a09e-9a1dc2c6a51e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:42.290784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9e775bba-69c3-4f05-a09e-9a1dc2c6a51e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1242 microversion: 2.1 time: 0.070894 Aug 06 20:45:42.296307 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 391/790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:42 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:43.312160 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:43.312899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:43.320286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:43.320833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:43.321401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:43.322562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:43.323400 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:43.324161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:43.445872 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:43.455354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-aed20f87-8430-4124-860c-fd73bdc56732 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1302 microversion: 2.1 time: 0.147609 Aug 06 20:45:43.456356 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 400/791] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:43 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1302 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:44.476947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:44.477556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:44.484361 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:44.485111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:44.485541 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:44.486237 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:44.486684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:44.487105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:44.619628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:44.627684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a701c0d1-4ae6-49a4-91b9-87c9d46e6209 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.154556 Aug 06 20:45:44.628245 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 392/792] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:44 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:45.649874 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:45.650483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:45.657950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:45.658801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:45.659641 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:45.660882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:45.661748 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:45.662533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:45.787445 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:45.794782 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7b47823d-d395-4fb4-8926-a1fd642d877d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.148770 Aug 06 20:45:45.795365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 401/793] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:45 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:46.484605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-9221421b-6bd9-425f-8213-d0eb41fb255a req-09922446-a278-4416-ae8b-f03cb4bc9618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c207f3-a163-4286-9ed2-bad238be3153", "tag": "2f97141f-72f8-4002-8ace-daf7d0f53969"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:46.494274 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9221421b-6bd9-425f-8213-d0eb41fb255a req-09922446-a278-4416-ae8b-f03cb4bc9618 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:46.494684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9221421b-6bd9-425f-8213-d0eb41fb255a req-09922446-a278-4416-ae8b-f03cb4bc9618 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:46.495115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9221421b-6bd9-425f-8213-d0eb41fb255a req-09922446-a278-4416-ae8b-f03cb4bc9618 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:46.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-9221421b-6bd9-425f-8213-d0eb41fb255a req-09922446-a278-4416-ae8b-f03cb4bc9618 service nova] Creating event network-changed:2f97141f-72f8-4002-8ace-daf7d0f53969 for instance 93c207f3-a163-4286-9ed2-bad238be3153 on hv-cinder-85199 Aug 06 20:45:46.511271 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-9221421b-6bd9-425f-8213-d0eb41fb255a req-09922446-a278-4416-ae8b-f03cb4bc9618 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030913 Aug 06 20:45:46.511867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 393/794] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:45:46.815199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:46.815765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:46.822057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:46.822544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:46.822977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:46.823692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:46.824145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:46.824598 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:46.828568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:46.951543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:46.958817 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bd399117-c7e5-4c93-92b2-898e7b7ea919 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.147555 Aug 06 20:45:46.959424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 402/795] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:46 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:47.980492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:47.981354 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:47.987532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:47.988018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:47.988453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:47.989146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:47.989603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:47.990028 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:48.115915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:48.123175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fc892e4f-287c-4514-a1b8-a21f465ed5e7 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.147347 Aug 06 20:45:48.123768 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 394/796] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:47 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:49.144104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:49.144721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:49.151116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:49.151636 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:49.152073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:49.152768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:49.153231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:49.153658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:49.282465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:49.289860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-75fc2897-23ef-4d7f-812a-2f468c088cd4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.150237 Aug 06 20:45:49.290427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 403/797] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:49 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:50.311017 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:50.311664 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:50.318122 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:50.318608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:50.319048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:50.319839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:50.320429 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:50.320955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:50.461562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:50.468972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3b4f4108-e60f-4936-8b57-6241a0a5f02e tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.162183 Aug 06 20:45:50.469522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 395/798] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:50 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:51.490957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:51.491607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:51.498000 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:51.498489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:51.498933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:51.500142 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:51.500605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:51.501039 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:51.636198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:51.644821 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3167b425-9114-4f4f-a2db-96e5317dc4eb tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.157747 Aug 06 20:45:51.645391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 404/799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:51 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:52.666173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:52.666812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:52.670581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:52.674801 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:52.675305 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:52.675744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:52.676449 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:52.677002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:52.677327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:52.820350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:52.828373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-77f66022-3bc8-4f91-b466-296049672131 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.166304 Aug 06 20:45:52.828940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 396/800] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:52 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:45:53.849048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:53.849662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:53.851740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:53.852390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:53.858954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:53.859471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:53.859911 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:53.860611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:53.861066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:53.861497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:54.020035 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:54.027815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-204cd10e-b1ef-4818-9a7c-3f6cc643a38c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.182555 Aug 06 20:45:54.028395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 405/801] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:53 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:55.049148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:55.049754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:55.056125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:55.056609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:55.057041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:55.057729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:55.058178 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:55.058595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:55.191127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:55.198992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d812099e-b988-484a-b224-42f7a765fbef tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.153507 Aug 06 20:45:55.199578 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 397/802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:55 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:55.474233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-bef77d67-d97d-49a3-a7d6-06a64b4d5ee6 req-4fe568e1-118c-4d31-83f6-6ce136d23b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c207f3-a163-4286-9ed2-bad238be3153", "name": "network-vif-plugged", "status": "completed", "tag": "2f97141f-72f8-4002-8ace-daf7d0f53969"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:45:55.485749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-bef77d67-d97d-49a3-a7d6-06a64b4d5ee6 req-4fe568e1-118c-4d31-83f6-6ce136d23b70 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:55.486263 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-bef77d67-d97d-49a3-a7d6-06a64b4d5ee6 req-4fe568e1-118c-4d31-83f6-6ce136d23b70 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:55.486877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-bef77d67-d97d-49a3-a7d6-06a64b4d5ee6 req-4fe568e1-118c-4d31-83f6-6ce136d23b70 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:55.651632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-bef77d67-d97d-49a3-a7d6-06a64b4d5ee6 req-4fe568e1-118c-4d31-83f6-6ce136d23b70 service nova] Creating event network-vif-plugged:2f97141f-72f8-4002-8ace-daf7d0f53969 for instance 93c207f3-a163-4286-9ed2-bad238be3153 on hv-cinder-85199 Aug 06 20:45:55.657107 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-bef77d67-d97d-49a3-a7d6-06a64b4d5ee6 req-4fe568e1-118c-4d31-83f6-6ce136d23b70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188082 Aug 06 20:45:55.657699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 406/803] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:56.220457 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:56.221116 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:56.227644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:56.228326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:56.229233 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:56.230657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:56.231611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:56.232046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:56.368371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:56.376285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-61a159ce-4dc0-410e-837e-191169845a2f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.160667 Aug 06 20:45:56.376916 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 398/804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:56 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:57.398158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:57.398987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:57.405689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:57.406392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:57.406889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:57.407685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:57.408205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:57.408695 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:57.539722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:57.547227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e1a3ff4a-a216-491d-98d9-054cb3bddc72 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1368 microversion: 2.1 time: 0.154405 Aug 06 20:45:57.547941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 407/805] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:57 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:45:58.568594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:58.569205 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:58.575659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:58.576138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:58.576571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:58.577282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:58.577732 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:58.578148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:58.580718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:58.712464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:45:58.720513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1ec4371a-4975-45f1-bfd9-e697c41bd44a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1556 microversion: 2.1 time: 0.155778 Aug 06 20:45:58.721080 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 399/806] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:45:58 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:45:58.740721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:45:58.741236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:45:58.747478 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:58.747959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:58.748393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:58.749085 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:45:58.749534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:45:58.749959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:45:58.824859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a029aa33-d99a-413e-baea-0d1bb742e8d8 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087848 Aug 06 20:45:58.825443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 408/807] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 20:45:58 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:45:59.996896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-77343795-6b69-46b7-bca0-d9a7d0bb6e7d req-775a747c-6ba7-46ba-8eb7-ccb043266437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c207f3-a163-4286-9ed2-bad238be3153", "tag": "2f97141f-72f8-4002-8ace-daf7d0f53969"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:46:00.002440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:00.008203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-77343795-6b69-46b7-bca0-d9a7d0bb6e7d req-775a747c-6ba7-46ba-8eb7-ccb043266437 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:00.008684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-77343795-6b69-46b7-bca0-d9a7d0bb6e7d req-775a747c-6ba7-46ba-8eb7-ccb043266437 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:00.009110 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-77343795-6b69-46b7-bca0-d9a7d0bb6e7d req-775a747c-6ba7-46ba-8eb7-ccb043266437 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:00.021019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-77343795-6b69-46b7-bca0-d9a7d0bb6e7d req-775a747c-6ba7-46ba-8eb7-ccb043266437 service nova] Creating event network-changed:2f97141f-72f8-4002-8ace-daf7d0f53969 for instance 93c207f3-a163-4286-9ed2-bad238be3153 on hv-cinder-85199 Aug 06 20:46:00.026051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-77343795-6b69-46b7-bca0-d9a7d0bb6e7d req-775a747c-6ba7-46ba-8eb7-ccb043266437 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032788 Aug 06 20:46:00.026764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 400/808] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:31.737066 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:31.738445 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=35 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:31.961239 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2f45d40a-8e57-4488-bfd6-f15b115615fb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Action: 'create', calling method: .version_select at 0x7fba956b33a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1605884297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4Rzmtaei9ZjmapKpJZMt8ZD3QU/EAYRCVVpH885hhiBm+gaYYVEr8RruLtPwJUhpVOl5mcaA5iKO77xVHljmwaEec/Z702NxQvJ/k5Bmxt7FPetj4E2X3G425x7O6sQw=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:46:31.977237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-2f45d40a-8e57-4488-bfd6-f15b115615fb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Getting quotas for project 74291027525f431293bb7c09c20dab12. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:46:31.981137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-2f45d40a-8e57-4488-bfd6-f15b115615fb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Getting quotas for user 1e651cfebd634d5cb2eb6df101c8ac84 and project 74291027525f431293bb7c09c20dab12. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:46:32.004663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2f45d40a-8e57-4488-bfd6-f15b115615fb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.273454 Aug 06 20:46:32.005248 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 409/809] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:46:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:48.868143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=7 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:48.868797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:48.873418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:48.874008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:48.880884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:48.881371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:48.881812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:48.882508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:48.882967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:48.883431 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:48.907049 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-342e191a-e510-4e07-b23f-918dc6edcd9d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/ips" status: 200 len: 145 microversion: 2.1 time: 0.040837 Aug 06 20:46:48.907640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 401/810] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:46:48 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:50.348481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:50.349019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:50.351395 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=4 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:50.352034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:50.358898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:50.359421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:50.359860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:50.360552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:50.361005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:50.361428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:50.384557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c23a9d8f-5039-40c8-a203-363b48a90655 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/ips" status: 200 len: 151 microversion: 2.20 time: 0.039979 Aug 06 20:46:50.385108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 410/811] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Aug 6 20:46:50 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:46:51.283092 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b652c318-6433-4919-9254-9f74811ac827"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:46:51.285409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:51.291739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:51.292224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:51.292659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:51.293347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:51.293803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:51.294230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:51.559533 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7e82ab59-18a0-4fe1-a1a7-8b415d34004c tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280736 Aug 06 20:46:51.560227 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 402/812] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:46:51 2022] POST /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:53.232828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:46:53.233386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:53.239778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:53.240284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:53.240723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:53.241417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:53.241871 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:53.242295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:53.264975 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lazy-loading 'flavor' on Instance uuid ea3ecda1-4a6d-4688-82b3-a20816a260c0 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:46:53.436607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a7654962-cd53-4e5e-9046-839e435449d4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/action" status: 202 len: 0 microversion: 2.20 time: 0.207462 Aug 06 20:46:53.437177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 411/813] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 20:46:53 2022] POST /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:46:53.445871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:53.446570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:53.454178 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:53.454712 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:53.455186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:53.456909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:53.456909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:53.456909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:53.588493 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:53.596439 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:53.597943 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:53.599128 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e49aa7c1-9ff5-41f9-994d-0e6ad8bc8e08 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.157443 Aug 06 20:46:53.599709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 403/814] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:46:53 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:54.622776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:54.623518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:54.630401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:54.630888 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:54.631353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:54.632044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:54.632502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:54.632928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:54.760892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:54.769439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:54.770972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:54.772159 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-725659ec-3c4c-44a2-8305-866a25cefd30 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.154159 Aug 06 20:46:54.772718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 412/815] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:46:54 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:55.795482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:55.796095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:55.802567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:55.803061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:55.803533 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:55.804233 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:55.804694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:55.805124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:55.937004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:55.945376 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:55.946875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:55.948104 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-62266493-190b-44b7-92fe-cbd2117fc7c6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.157095 Aug 06 20:46:55.948664 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 404/816] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:46:55 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:56.668518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-820808385", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1605884297", "security_groups": [{"name": "tempest-secgroup-smoke-165539849"}], "networks": [{"uuid": "902950c8-78df-4a2f-b94d-51fe69448efd"}], "block_device_mapping_v2": [{"uuid": "f1183cd4-eabb-431a-afcb-1f7628b6616e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:46:56.779743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] validate_networks() for [('902950c8-78df-4a2f-b94d-51fe69448efd', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:46:56.970889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:56.971538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:56.977801 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:56.978287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:56.978726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:56.979458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:56.979919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:56.980343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:57.181406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:57.189429 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:57.190923 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:57.192091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-56723d26-8bae-4a92-b754-06995d0326a7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.225018 Aug 06 20:46:57.192639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 405/817] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:46:56 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:46:57.202308 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:46:57.202736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:46:57.203257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:46:57.203682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:46:57.204098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:46:57.213032 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:57.213513 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:57.213953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:57.214678 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:57.215136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:57.215585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:57.232933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Getting quotas for project 74291027525f431293bb7c09c20dab12. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:46:57.236853 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Getting quotas for user 1e651cfebd634d5cb2eb6df101c8ac84 and project 74291027525f431293bb7c09c20dab12. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:46:57.292073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:46:57.294126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1183cd4-eabb-431a-afcb-1f7628b6616e',volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:46:57.424524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3ba487ee-2ef1-4c4a-bd94-11cc3783bd3c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759853 Aug 06 20:46:57.425163 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 413/818] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:46:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:46:57.436294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0451e9c7-3e33-4793-a18a-1f42a6e8f3e0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:57.436879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0451e9c7-3e33-4793-a18a-1f42a6e8f3e0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:57.494339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0451e9c7-3e33-4793-a18a-1f42a6e8f3e0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:57.500949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0451e9c7-3e33-4793-a18a-1f42a6e8f3e0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1088 microversion: 2.1 time: 0.068810 Aug 06 20:46:57.501503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 406/819] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:46:57 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:46:58.214606 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:58.215217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:58.221807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:58.222294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:58.222732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:58.223459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:58.223919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:58.224346 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:58.362905 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:58.371812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:58.373381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:58.374548 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-44034fd7-6649-4ace-b1ce-eb7e1f68db05 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.164582 Aug 06 20:46:58.375102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 414/820] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:46:58 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:58.521424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:58.522031 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:58.529470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:58.529951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:58.530380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:58.531055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:58.531525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:58.531940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:58.590030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:58.598197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-16d26097-cfb0-4704-821d-dc6c7362ca4c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1130 microversion: 2.1 time: 0.080592 Aug 06 20:46:58.598759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 407/821] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:46:58 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1130 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:46:59.075581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:59.077791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:59.083614 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.084098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.084528 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.085208 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.085661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.086338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.114756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6e1c9cb3-16a1-44a9-ab15-a017ea27dda6 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 Aug 06 20:46:59.115486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 415/822] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:46:59 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:59.126475 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:59.126967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:59.132796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.133277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.133707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.134394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.134846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.135290 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.163522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f28536bf-6bdb-4945-bf6c-6c8129d239d2 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/b652c318-6433-4919-9254-9f74811ac827" status: 200 len: 194 microversion: 2.1 time: 0.041700 Aug 06 20:46:59.163994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 408/823] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Aug 6 20:46:59 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/b652c318-6433-4919-9254-9f74811ac827 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:46:59.400350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:59.402393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:59.413610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.415629 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.416456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.417317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.417893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.418427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.619052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:46:59.619696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:46:59.625986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.626420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.626862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.627586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:46:59.628051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:46:59.628516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:46:59.651680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:59.660388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:59.661901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:59.663128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7ef431c1-06ef-473b-be95-2126da6c9fe8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.267432 Aug 06 20:46:59.663713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 416/824] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:46:59 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:46:59.699805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:46:59.707382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-21855c7c-493b-4bf2-9465-0b34512a65a5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1204 microversion: 2.1 time: 0.092157 Aug 06 20:46:59.707956 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 409/825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:46:59 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:47:00.521375 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbf3a576-f0cd-47dd-a356-f0d0bf7f6a1f"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:00.524660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:00.531607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.532100 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.532535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:00.533232 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.533688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.534152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:00.686959 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:00.687821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:00.695063 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.696912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.697399 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:00.698076 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.699082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.699545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:00.870968 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ce239fee-db89-4fe5-b0bf-940477ffcc51 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "POST /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353576 Aug 06 20:47:00.871714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 417/826] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:47:00 2022] POST /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:00.877456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-f473418c-385c-4c65-86cb-98c37d8228cf req-1dc4efa1-9323-4f46-aed0-7f70aab74e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:00.889438 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-f473418c-385c-4c65-86cb-98c37d8228cf req-1dc4efa1-9323-4f46-aed0-7f70aab74e8e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.889919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-f473418c-385c-4c65-86cb-98c37d8228cf req-1dc4efa1-9323-4f46-aed0-7f70aab74e8e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.890349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-f473418c-385c-4c65-86cb-98c37d8228cf req-1dc4efa1-9323-4f46-aed0-7f70aab74e8e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:00.901524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:00.901693 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-f473418c-385c-4c65-86cb-98c37d8228cf req-1dc4efa1-9323-4f46-aed0-7f70aab74e8e service nova] Creating event network-changed:6ed5e7a9-6704-4da7-8d53-4918b2a196b9 for instance 14b71891-ae29-4234-aa8e-8bd19d79e119 on hv-cinder-85199 Aug 06 20:47:00.910362 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:00.911995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-f473418c-385c-4c65-86cb-98c37d8228cf req-1dc4efa1-9323-4f46-aed0-7f70aab74e8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038193 Aug 06 20:47:00.912592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 418/827] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:00.917448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:00.917608 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:00.918212 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:00.918703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3a003009-a693-41ee-a48e-71bf87f7d588 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.236339 Aug 06 20:47:00.919156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 410/828] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:00 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:00.924827 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.925317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.925756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:00.926456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:00.926915 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:00.927402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:01.136713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:01.144463 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d69b3865-44cc-46a8-b741-2ba676a199c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.230765 Aug 06 20:47:01.145327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 419/829] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:00 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:01.942019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:01.942553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:01.949119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:01.949598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:01.950030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:01.951375 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:01.951828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:01.952249 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:02.082986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:02.091184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:02.092717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:02.093868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-174e7600-2cbc-44b1-ad60-b9d8bdf2054d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.155794 Aug 06 20:47:02.094430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 411/830] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:01 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:02.165863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:02.166479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:02.173325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:02.173815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:02.174256 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:02.174954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:02.175441 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:02.175875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:02.304366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:02.312443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2b2d351b-f845-48ab-ba87-0374028c73da tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.150473 Aug 06 20:47:02.313009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 420/831] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:02 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:03.117084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:03.117761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:03.125272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:03.125757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:03.126193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:03.126892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:03.127380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:03.127807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:03.253589 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:03.261355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:03.262884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:03.264065 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9231b3be-352b-4278-bac4-de190028c33a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.150954 Aug 06 20:47:03.264614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 412/832] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:03 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:03.332597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:03.333204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:03.339859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:03.340340 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:03.340770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:03.341452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:03.341898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:03.342316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:03.480052 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:03.487605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c3ac4e02-1870-4453-98c5-6eaeddb9b2e2 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.158707 Aug 06 20:47:03.488198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 421/833] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:03 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:04.286208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:04.286813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:04.293285 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:04.293766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:04.294695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:04.295408 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:04.295868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:04.296290 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:04.425091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:04.432962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:04.434460 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:04.436231 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4b6e90cd-db8f-4c05-b022-8450f43bdc17 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.153911 Aug 06 20:47:04.436785 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 413/834] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:04 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:04.508402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:04.509008 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:04.515348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:04.515826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:04.516258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:04.516938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:04.517389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:04.517806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:04.648541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:04.659462 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-701843a1-ba75-4465-89ba-74ec43ba792f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.154486 Aug 06 20:47:04.660053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 422/835] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:04 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:05.458220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:05.458734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:05.465406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:05.465893 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:05.466333 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:05.467029 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:05.467510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:05.467941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:05.592934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:05.600798 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:05.602291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:05.603472 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-aa3103b6-f2c8-4103-93fe-d0dfde4dc042 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1743 microversion: 2.20 time: 0.149173 Aug 06 20:47:05.604024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 414/836] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:05 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:05.680846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:05.681470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:05.692586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:05.693486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:05.694280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:05.695075 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:05.695611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:05.696042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:05.827084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:05.834497 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d43d78c1-79e8-4108-99f0-8d775992f2b4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.157552 Aug 06 20:47:05.835063 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 423/837] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:05 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:06.625848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:06.626451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:06.632795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:06.633272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:06.633698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:06.634374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:06.634846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:06.635298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:06.761173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:06.769710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:06.771215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:06.772392 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-91c93992-fe3e-44bf-a429-68d69f42d4ca tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1743 microversion: 2.20 time: 0.150420 Aug 06 20:47:06.772951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 415/838] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:06 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:06.855306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:06.855844 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:06.862148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:06.862625 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:06.863056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:06.863770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:06.864222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:06.864642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:06.990313 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:06.993796 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:06.998955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0ef1a317-2847-4310-bbe7-e670a44bb094 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.147590 Aug 06 20:47:06.999545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 424/839] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:06 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:07.795679 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:07.796287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:07.798255 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:07.804055 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:07.804518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:07.804981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:07.805624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:07.806077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:07.806506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:07.938142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:07.946015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:07.947561 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:07.948710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-af253087-8b8c-400f-ac41-a0e3b2d1e901 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1743 microversion: 2.20 time: 0.156997 Aug 06 20:47:07.949282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 416/840] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:07 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:08.020392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:08.021007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:08.022832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:08.023517 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:08.031362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:08.031862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:08.032310 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:08.033020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:08.033482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:08.033916 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:08.163924 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:08.171333 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9ef4bb5a-1687-4c4b-a99d-abc278915343 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.155153 Aug 06 20:47:08.171914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 425/841] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:08 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:08.972232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:08.972773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:08.979090 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:08.979614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:08.980052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:08.980728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:08.981178 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:08.981600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:08.998682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:09.111158 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:09.118920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:09.120449 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:09.121601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-77dc82fb-e796-4763-a924-cd85814144eb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1743 microversion: 2.20 time: 0.153327 Aug 06 20:47:09.122155 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 417/842] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:08 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:09.191639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:09.192259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:09.198538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:09.199025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:09.199496 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:09.200190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:09.201271 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:09.201699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:09.329647 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:09.337223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-393738b0-b482-445b-b565-c091ead0ec62 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.149415 Aug 06 20:47:09.337776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 426/843] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:09 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:09.805766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-90589c4c-07c0-4f18-8d47-8eab10e3d20d req-120fedd9-85ff-4eae-a15b-0f920a0deab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "name": "network-vif-plugged", "status": "completed", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:09.815757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-90589c4c-07c0-4f18-8d47-8eab10e3d20d req-120fedd9-85ff-4eae-a15b-0f920a0deab9 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:09.816237 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-90589c4c-07c0-4f18-8d47-8eab10e3d20d req-120fedd9-85ff-4eae-a15b-0f920a0deab9 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:09.817486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-90589c4c-07c0-4f18-8d47-8eab10e3d20d req-120fedd9-85ff-4eae-a15b-0f920a0deab9 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:09.831708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-90589c4c-07c0-4f18-8d47-8eab10e3d20d req-120fedd9-85ff-4eae-a15b-0f920a0deab9 service nova] Creating event network-vif-plugged:6fd7b112-713c-4645-9ef1-dadf3f856ec4 for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 on hv-cinder-85199 Aug 06 20:47:09.837253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-90589c4c-07c0-4f18-8d47-8eab10e3d20d req-120fedd9-85ff-4eae-a15b-0f920a0deab9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Aug 06 20:47:09.838066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 418/844] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:10.144214 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:10.144743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:10.150607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:10.151083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:10.151555 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:10.152233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:10.152684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:10.153104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:10.277010 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:10.285482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:10.286976 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:10.288154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-61fc5ba2-940a-4e60-aa42-1c2fc759cf1b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1743 microversion: 2.20 time: 0.147900 Aug 06 20:47:10.288705 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 427/845] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:10 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:10.358131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:10.358820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:10.365319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:10.365794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:10.366222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:10.366899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:10.367374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:10.367792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:10.607711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:10.615461 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3291b9e7-139b-4eb3-a90f-c89c567327c9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.261424 Aug 06 20:47:10.616011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 419/846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:10 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:11.311145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:11.311773 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:11.318390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.318875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.319545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.320247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.320721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.321145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.454439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:11.464235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:11.466483 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:11.468183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fac6e513-8ff5-4018-bb97-1d00f7e2cbd8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.161857 Aug 06 20:47:11.469028 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 428/847] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:11 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:11.579534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:11.581783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:11.588786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.589256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.589767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.590357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.590819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.591761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.622556 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-94f5631a-eba4-4700-8f21-7cbe81aa01f4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046866 Aug 06 20:47:11.623120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 420/848] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:47:11 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:11.635540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:11.636148 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:11.642227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.642706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.643140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.643845 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.644299 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.644732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.772080 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:11.772578 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:11.779665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.780149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.780848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.782355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.783066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.784173 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.820522 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d41766ea-2279-4620-b45b-f2e7defd00df tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/b652c318-6433-4919-9254-9f74811ac827" status: 200 len: 194 microversion: 2.1 time: 0.055825 Aug 06 20:47:11.827851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:11.828244 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 421/849] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Aug 6 20:47:11 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/b652c318-6433-4919-9254-9f74811ac827 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:11.833840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:11.834594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:11.835759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e3132047-912a-4ca1-918d-f07b5e0d5565 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.203881 Aug 06 20:47:11.836596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 429/850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:11 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:11.854735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.855753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.856452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.857400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:11.858498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:11.859383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:11.955414 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lazy-loading 'services' on Instance uuid 845436a8-214f-479a-8b98-6d7d1dd197cb {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:47:12.033857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c7baca75-dfc6-4aa6-b1e5-3f9735edc00a tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/b652c318-6433-4919-9254-9f74811ac827" status: 202 len: 0 microversion: 2.1 time: 0.203707 Aug 06 20:47:12.034452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 422/851] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:47:11 2022] DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/b652c318-6433-4919-9254-9f74811ac827 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:47:12.494320 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:12.494929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:12.503569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:12.504327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:12.504955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:12.505665 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:12.506337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:12.507801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:12.660265 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:12.669526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:12.671041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:12.672251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-aeaad6ff-dc95-43e8-9d43-ecdca7bfeb9f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.182719 Aug 06 20:47:12.672807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 430/852] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:12 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:12.858001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:12.858596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:12.864977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:12.865533 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:12.865965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:12.866656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:12.867101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:12.867729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:13.015017 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:13.024771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8e52211a-f51b-4327-b535-f0de6a0276d6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.171234 Aug 06 20:47:13.027287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 423/853] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:12 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:13.694068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:13.695554 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:13.706708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:13.707189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:13.708741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:13.709450 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:13.709907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:13.710330 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:13.866618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-45770d6e-975e-4af2-a37d-df678f48b43a req-46b29cc1-1620-43bd-b49c-8e3ef777c952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:13.879076 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-45770d6e-975e-4af2-a37d-df678f48b43a req-46b29cc1-1620-43bd-b49c-8e3ef777c952 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:13.879971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-45770d6e-975e-4af2-a37d-df678f48b43a req-46b29cc1-1620-43bd-b49c-8e3ef777c952 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:13.880722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-45770d6e-975e-4af2-a37d-df678f48b43a req-46b29cc1-1620-43bd-b49c-8e3ef777c952 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:13.896354 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-45770d6e-975e-4af2-a37d-df678f48b43a req-46b29cc1-1620-43bd-b49c-8e3ef777c952 service nova] Creating event network-vif-plugged:6ed5e7a9-6704-4da7-8d53-4918b2a196b9 for instance 14b71891-ae29-4234-aa8e-8bd19d79e119 on hv-cinder-85199 Aug 06 20:47:13.900561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:13.901970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-45770d6e-975e-4af2-a37d-df678f48b43a req-46b29cc1-1620-43bd-b49c-8e3ef777c952 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038809 Aug 06 20:47:13.902752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 424/854] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:47:13.910425 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:13.912194 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:13.913739 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8bb10407-a3bc-4330-8e41-7502c0c3eade tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.223584 Aug 06 20:47:13.914522 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 431/855] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:13 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:14.048236 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:14.049095 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:14.062179 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.062660 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.063143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.063981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.064643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.065232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.249176 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:14.249908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:14.256460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.256955 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.257397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.258135 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.258618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.259077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.290115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:14.291089 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7155b13f-36bf-402b-a5fc-f41f0f0c1110 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/fbf3a576-f0cd-47dd-a356-f0d0bf7f6a1f" status: 200 len: 194 microversion: 2.1 time: 0.046962 Aug 06 20:47:14.292044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 432/856] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Aug 6 20:47:14 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/fbf3a576-f0cd-47dd-a356-f0d0bf7f6a1f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:14.301356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1d3e312e-76d0-460e-aa44-da89d3a80391 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.259436 Aug 06 20:47:14.311821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 425/857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:14 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:14.320333 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:14.321125 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:14.327980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.328718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.329256 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.330189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.330746 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.331443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.419667 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lazy-loading 'services' on Instance uuid 845436a8-214f-479a-8b98-6d7d1dd197cb {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:47:14.499630 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-87c7dc48-e4cd-4992-aa62-8e569f307faf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/fbf3a576-f0cd-47dd-a356-f0d0bf7f6a1f" status: 202 len: 0 microversion: 2.1 time: 0.200751 Aug 06 20:47:14.500480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 433/858] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:47:14 2022] DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments/fbf3a576-f0cd-47dd-a356-f0d0bf7f6a1f => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:47:14.939409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:14.940247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:14.948070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.948627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.949050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:14.949783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:14.950244 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:14.950676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:15.095739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:15.104543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:15.106135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:15.107888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-28e567be-18f1-4927-bc4f-5e7765729a63 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.174617 Aug 06 20:47:15.108443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 426/859] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:14 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:15.326932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:15.327875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:15.335923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:15.336671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:15.337416 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:15.338119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:15.338571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:15.338997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:15.485358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:15.493354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-78090fe8-2e16-4979-9138-a9d56126d0ed tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1259 microversion: 2.1 time: 0.171049 Aug 06 20:47:15.494182 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 434/860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:15 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:16.131586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:16.132195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:16.140422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:16.141472 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:16.142009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:16.143080 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:16.144134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:16.144816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:16.286875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:16.297948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:16.299586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:16.300851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3143af8d-1b7f-44bf-a179-614c0a68d7a5 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.173084 Aug 06 20:47:16.315269 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 427/861] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:16 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:16.518936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:16.520238 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:16.527057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:16.527640 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:16.528074 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:16.529124 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:16.529731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:16.530492 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:16.779204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:16.787447 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-82fbedb4-b3bf-4ec5-a327-d5ca08afe976 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1444 microversion: 2.1 time: 0.273031 Aug 06 20:47:16.788389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 435/862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:16 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1444 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:16.813953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:16.814576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:16.821584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:16.822325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:16.822921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:16.823846 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:16.824459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:16.825066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:16.982041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:16.990106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-25c0aa37-9e83-42ba-9eff-ee3549b5f303 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1444 microversion: 2.1 time: 0.180878 Aug 06 20:47:16.990850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 428/863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:16 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:17.328404 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:17.329015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:17.335805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:17.336305 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:17.337001 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:17.337751 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:17.338215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:17.338680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:17.603994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:17.613814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:17.615418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:17.616855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6e8892ba-3888-46ae-91d8-5eae925d71a0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.292831 Aug 06 20:47:17.617468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 436/864] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:17 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:17.875030 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:17.877428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:17.884023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:17.884563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:17.884944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:17.885649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:17.886099 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:17.886530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:17.916896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-176b38b7-bfa5-4027-9e5b-28d7f9a86b76 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046314 Aug 06 20:47:17.923994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 429/865] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:47:17 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:47:18.071790 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:18.074093 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:18.081227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.081990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.082432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.083127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.083610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.084030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.132297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d71c80f5-4d21-4ff3-900c-bdc1d6588514 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064096 Aug 06 20:47:18.133579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 437/866] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:47:18 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 20:47:18.209609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:18.210111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:18.217347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.217848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.218528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.219507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.219979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.220409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.252323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:47:18.354980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-42ad507b-28f1-4586-9b99-77e5dbd1560e tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 204 len: 0 microversion: 2.1 time: 0.149585 Aug 06 20:47:18.358761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 430/867] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:18 2022] DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:47:18.366014 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:18.366566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:18.375861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.376449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.377506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.382930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.383930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.383930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.641630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:18.642237 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:18.649012 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.650005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.650005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.650677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:18.651649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:18.652143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:18.689472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:18.703592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bb9c9657-3ffa-4eba-84da-a8c54ec1cd49 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1672 microversion: 2.1 time: 0.342715 Aug 06 20:47:18.704270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 438/868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:18 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1672 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:18.898201 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:18.909701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:18.911771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:18.913221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-65a4a52f-a30c-4495-89a8-a01409b41a27 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.276031 Aug 06 20:47:18.928651 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 431/869] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:18 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:19.237690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-9ce375c0-0dd5-4fab-9c39-608f008ee9fc req-e85bd6c3-8413-45ea-b65f-89fa92c48344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:19.249311 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-9ce375c0-0dd5-4fab-9c39-608f008ee9fc req-e85bd6c3-8413-45ea-b65f-89fa92c48344 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:19.249894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-9ce375c0-0dd5-4fab-9c39-608f008ee9fc req-e85bd6c3-8413-45ea-b65f-89fa92c48344 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:19.250337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-9ce375c0-0dd5-4fab-9c39-608f008ee9fc req-e85bd6c3-8413-45ea-b65f-89fa92c48344 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:19.268946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-9ce375c0-0dd5-4fab-9c39-608f008ee9fc req-e85bd6c3-8413-45ea-b65f-89fa92c48344 service nova] Creating event network-changed:6ed5e7a9-6704-4da7-8d53-4918b2a196b9 for instance 14b71891-ae29-4234-aa8e-8bd19d79e119 on hv-cinder-85199 Aug 06 20:47:19.274820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-9ce375c0-0dd5-4fab-9c39-608f008ee9fc req-e85bd6c3-8413-45ea-b65f-89fa92c48344 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040794 Aug 06 20:47:19.275625 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 439/870] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:19.730970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:19.733021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:19.743434 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:19.745571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:19.745976 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:19.746136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:19.747547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:19.748081 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:19.749044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:19.901701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:19.911883 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6d0eb20c-373f-432b-96a5-7fb41fb1374d tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1672 microversion: 2.1 time: 0.187384 Aug 06 20:47:19.912189 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 432/871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:19 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:19.938635 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:19.939983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:19.947494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:19.948337 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:19.948935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:19.949820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:19.950498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:19.951080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:20.115304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:47:20.116100 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 20:47:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:47:20.175060 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:20.184370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:20.189486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:20.190699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d893ce3c-ce79-4491-966f-138c9444d4ab tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.257108 Aug 06 20:47:20.218056 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 440/872] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:19 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:20.936219 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:20.937575 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:20.944296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:20.944771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:20.945209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:20.945950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:20.946408 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:20.946828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:20.957402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:21.216808 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:21.219649 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:21.232816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:21.237374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:21.238445 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:21.239220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:21.240857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:21.241622 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:21.242862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:21.291761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:21.497539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:21.505843 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-84be321a-6714-4066-bcd0-ffaedc934fd4 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1672 microversion: 2.1 time: 0.576789 Aug 06 20:47:21.507553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 433/873] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:20 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1672 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:21.610889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:21.618846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:21.620397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:21.621577 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-602a255f-cd62-4d4e-92e1-17d9d54c11bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1738 microversion: 2.20 time: 0.411370 Aug 06 20:47:21.624627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 441/874] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:21 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1738 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:22.199283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-3fd7fcb6-f1ac-429b-808d-507608fbaed3 req-6ec348ae-ae11-4c8c-8a85-470ad8395b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "845436a8-214f-479a-8b98-6d7d1dd197cb", "name": "network-vif-deleted", "tag": "e18a9e09-77ea-4980-8e71-9106895598be"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:22.209250 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3fd7fcb6-f1ac-429b-808d-507608fbaed3 req-6ec348ae-ae11-4c8c-8a85-470ad8395b5e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:22.209739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3fd7fcb6-f1ac-429b-808d-507608fbaed3 req-6ec348ae-ae11-4c8c-8a85-470ad8395b5e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:22.210168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3fd7fcb6-f1ac-429b-808d-507608fbaed3 req-6ec348ae-ae11-4c8c-8a85-470ad8395b5e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:22.222444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-3fd7fcb6-f1ac-429b-808d-507608fbaed3 req-6ec348ae-ae11-4c8c-8a85-470ad8395b5e service nova] Creating event network-vif-deleted:e18a9e09-77ea-4980-8e71-9106895598be for instance 845436a8-214f-479a-8b98-6d7d1dd197cb on hv-cinder-85199 Aug 06 20:47:22.229278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-3fd7fcb6-f1ac-429b-808d-507608fbaed3 req-6ec348ae-ae11-4c8c-8a85-470ad8395b5e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Aug 06 20:47:22.233482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 434/875] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:22.531478 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:22.532011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:22.539220 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:22.539758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:22.540200 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:22.540908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:22.541371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:22.541799 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:22.578366 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:22.579105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:22.579722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:22.580353 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lazy-loading 'fault' on Instance uuid 845436a8-214f-479a-8b98-6d7d1dd197cb {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:47:22.641331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86090cd4247d4d598eb1976f4224b4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9193df5e4d39448c947cfbb3139306bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:22.645726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:22.646416 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:22.649361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fdb3e124-f679-449a-96f0-1a99d9e4db58 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 200 len: 1327 microversion: 2.1 time: 0.123463 Aug 06 20:47:22.650188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 442/876] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:22 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:22.666701 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:22.667198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:22.667935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:22.668655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:22.669147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:22.669572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:22.802041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:22.810275 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:22.811792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:22.812948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-de45dc22-833c-4e68-8102-3325c3c0d2b6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1720 microversion: 2.20 time: 0.171387 Aug 06 20:47:22.813500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 435/877] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:22 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:23.671302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:23.671942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:23.678248 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:23.678736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:23.679174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:23.679897 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:23.680357 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:23.680784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:23.694023 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] HTTP exception thrown: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Request method failure captured: Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb HTTP/1.1 Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEB-skkaGPjiC2hfCOkA9GjUxe9JKS7kYBdU0G4a7gRj6RJDhI3Rq64igZbpRsrgF8aS7e5N9TC-atSBfFuRyZxiDqvdZ7X_HAjRcwdAK3pqrtRBX_gGVKPj4KlnOm31pMJjCVsykDYTwpwLm2L6AqNFKOsiACSEjsH8SmPha8_A2Q Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:23.695706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 86090cd4247d4d598eb1976f4224b4f3 Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:23.697137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '845436a8-214f-479a-8b98-6d7d1dd197cb'} Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:23.698258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:23.699582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:23.700682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Returning 404 to user: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:23.700682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b7bac7fa-11e2-4933-8483-050e70b99b4b tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 404 len: 111 microversion: 2.1 time: 0.031066 Aug 06 20:47:23.700682 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 443/878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:23 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:23.706119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ac450e19-e5a4-4826-8a24-b091c351a4cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '.version_select at 0x7fba95f69b80>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:23.726828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ac450e19-e5a4-4826-8a24-b091c351a4cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403535545" status: 202 len: 0 microversion: 2.1 time: 0.024477 Aug 06 20:47:23.727413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 436/879] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Aug 6 20:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403535545 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:47:23.836078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:23.837146 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:23.845091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:23.845590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:23.846031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:23.846877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:23.847361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:23.847791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:23.989954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:23.998757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:24.000410 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:24.001649 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-410887b6-2a51-43c4-a0c4-609d5cfb5ebb tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1720 microversion: 2.20 time: 0.169527 Aug 06 20:47:24.002278 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 444/880] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:23 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:25.024518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:25.025058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:25.032083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:25.032563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:25.032996 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:25.033678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:25.034130 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:25.034553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:25.160521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:25.169288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:25.170822 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:25.173011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0e68738c-a920-4e42-9a5e-319e190c83ec tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1720 microversion: 2.20 time: 0.152282 Aug 06 20:47:25.178217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 437/881] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:25 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:25.914551 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-77215060-6bb4-4ce7-8817-77a2ac9ea543 req-6cdabad9-b2af-419e-83e2-fcef63c59ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "name": "network-vif-unplugged", "status": "completed", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:25.925110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-77215060-6bb4-4ce7-8817-77a2ac9ea543 req-6cdabad9-b2af-419e-83e2-fcef63c59ebf service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:25.925670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-77215060-6bb4-4ce7-8817-77a2ac9ea543 req-6cdabad9-b2af-419e-83e2-fcef63c59ebf service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:25.926161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-77215060-6bb4-4ce7-8817-77a2ac9ea543 req-6cdabad9-b2af-419e-83e2-fcef63c59ebf service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:25.937422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.compute.server_external_events [req-77215060-6bb4-4ce7-8817-77a2ac9ea543 req-6cdabad9-b2af-419e-83e2-fcef63c59ebf service nova] Unable to find a host for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0. Dropping event network-vif-unplugged {{(pid=129475) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 20:47:25.938431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-77215060-6bb4-4ce7-8817-77a2ac9ea543 req-6cdabad9-b2af-419e-83e2-fcef63c59ebf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027876 Aug 06 20:47:25.939348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 445/882] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 20:47:26.195153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:26.195715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:26.204513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.204993 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.205425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.206111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.206560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.206977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.337143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:26.345496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:26.346985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:26.348157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-82f4a7b7-d1e5-4d2a-a356-314b2d17fd68 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1663 microversion: 2.20 time: 0.156975 Aug 06 20:47:26.348718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 438/883] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:26 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:26.369560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0e5e950-69da-4093-8b3a-f0ea4c7a0ae0"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:26.371941 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:26.377824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.378309 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.378749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.379491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.379954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.380382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.460186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:26.460680 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:26.466943 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.467553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.467996 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.468695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.469151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.469574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.492850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-23c333c1-bab4-4e1e-8d5e-bda59db84ba9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/ips" status: 200 len: 148 microversion: 2.1 time: 0.036386 Aug 06 20:47:26.493423 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 439/884] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:47:26 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:47:26.590346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:26.592093 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:26.598787 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.599344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.599790 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.600567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.601066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.601546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.616527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] HTTP exception thrown: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Request method failure captured: Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb HTTP/1.1 Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEB-skkaGPjiC2hfCOkA9GjUxe9JKS7kYBdU0G4a7gRj6RJDhI3Rq64igZbpRsrgF8aS7e5N9TC-atSBfFuRyZxiDqvdZ7X_HAjRcwdAK3pqrtRBX_gGVKPj4KlnOm31pMJjCVsykDYTwpwLm2L6AqNFKOsiACSEjsH8SmPha8_A2Q Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:26.618413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 86090cd4247d4d598eb1976f4224b4f3 Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.620078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '845436a8-214f-479a-8b98-6d7d1dd197cb'} Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:26.620919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.622859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.625737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Returning 404 to user: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:26.625737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6166fd2b-4bc0-47d4-b1a4-3c053b4f36a0 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 404 len: 111 microversion: 2.1 time: 0.034257 Aug 06 20:47:26.625737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 440/885] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:26 2022] DELETE /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:47:26.628545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:26.629322 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 845436a8-214f-479a-8b98-6d7d1dd197cb] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:26.635350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.635937 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.636377 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.637269 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.638430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.638876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.654007 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] HTTP exception thrown: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Request method failure captured: Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb HTTP/1.1 Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEB-skkaGPjiC2hfCOkA9GjUxe9JKS7kYBdU0G4a7gRj6RJDhI3Rq64igZbpRsrgF8aS7e5N9TC-atSBfFuRyZxiDqvdZ7X_HAjRcwdAK3pqrtRBX_gGVKPj4KlnOm31pMJjCVsykDYTwpwLm2L6AqNFKOsiACSEjsH8SmPha8_A2Q Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:26.655744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 86090cd4247d4d598eb1976f4224b4f3 Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.657247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '845436a8-214f-479a-8b98-6d7d1dd197cb'} Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:26.658087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. Aug 06 20:47:26.661673 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:26.663570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Returning 404 to user: Instance 845436a8-214f-479a-8b98-6d7d1dd197cb could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:26.663570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-daefa7db-071b-445d-99d7-aa6a3fe780cf tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb" status: 404 len: 111 microversion: 2.1 time: 0.032241 Aug 06 20:47:26.663570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 441/886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:26 2022] GET /compute/v2.1/servers/845436a8-214f-479a-8b98-6d7d1dd197cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:26.679472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f8917ff6-2b32-4bf6-8e03-6d73236d3428 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313599 Aug 06 20:47:26.680420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 446/887] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Aug 6 20:47:26 2022] POST /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 20:47:26.899050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:26.899676 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:26.906459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.907023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.907481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:26.908171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:26.908621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:26.909042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.252336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bcc52f6b-c155-4d27-990a-c798f26dacd3 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-volume_attachments/d0e5e950-69da-4093-8b3a-f0ea4c7a0ae0" status: 202 len: 0 microversion: 2.20 time: 0.356976 Aug 06 20:47:27.253309 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 442/888] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Aug 6 20:47:26 2022] DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-volume_attachments/d0e5e950-69da-4093-8b3a-f0ea4c7a0ae0 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:47:27.317172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:27.317768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:27.324410 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.324938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.325370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.326069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.326520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.326945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.377584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129475) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 20:47:27.447523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fefa9b7f-f518-4a1a-ba5b-d7a48b230db1 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "POST /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/action" status: 202 len: 0 microversion: 2.20 time: 0.134260 Aug 06 20:47:27.448502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 447/889] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 20:47:27 2022] POST /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:47:27.456662 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:27.457302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:27.464053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.464543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.464974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.466191 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.466639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.467058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.603314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:27.611686 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:27.613177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:27.614332 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b342322f-3452-45f9-a58e-37fbd04682e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1671 microversion: 2.20 time: 0.161813 Aug 06 20:47:27.614887 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 443/890] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:27 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:27.836030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:27.836901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:27.843304 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.843792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.844269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.844950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.845405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.845832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.859472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] HTTP exception thrown: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Request method failure captured: Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b HTTP/1.1 Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEB-skkaGPjiC2hfCOkA9GjUxe9JKS7kYBdU0G4a7gRj6RJDhI3Rq64igZbpRsrgF8aS7e5N9TC-atSBfFuRyZxiDqvdZ7X_HAjRcwdAK3pqrtRBX_gGVKPj4KlnOm31pMJjCVsykDYTwpwLm2L6AqNFKOsiACSEjsH8SmPha8_A2Q Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:27.861016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 86090cd4247d4d598eb1976f4224b4f3 Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.862354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '72752a0b-3b0b-428e-b578-4958b8a51a1b'} Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:27.863121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.864723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.866059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Returning 404 to user: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:27.866059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3986d37b-f737-4737-9c88-b724cf8d0340 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 404 len: 111 microversion: 2.1 time: 0.030444 Aug 06 20:47:27.866059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 448/891] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:27 2022] DELETE /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:27.871468 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:27.872086 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] [instance: 72752a0b-3b0b-428e-b578-4958b8a51a1b] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:27.878039 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.878535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.878969 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.879684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.880136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.880558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.894629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] HTTP exception thrown: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Request method failure captured: Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b HTTP/1.1 Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEB-skkaGPjiC2hfCOkA9GjUxe9JKS7kYBdU0G4a7gRj6RJDhI3Rq64igZbpRsrgF8aS7e5N9TC-atSBfFuRyZxiDqvdZ7X_HAjRcwdAK3pqrtRBX_gGVKPj4KlnOm31pMJjCVsykDYTwpwLm2L6AqNFKOsiACSEjsH8SmPha8_A2Q Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:27.896208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9193df5e4d39448c947cfbb3139306bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 9193df5e4d39448c947cfbb3139306bf Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919741929 Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 86090cd4247d4d598eb1976f4224b4f3 Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeTestJSON-919741929-project Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.897605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '72752a0b-3b0b-428e-b578-4958b8a51a1b'} Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:27.898343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. Aug 06 20:47:27.899644 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:27.900719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] Returning 404 to user: Instance 72752a0b-3b0b-428e-b578-4958b8a51a1b could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:27.900719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3c432918-953d-4929-9d47-2b459072c2a5 tempest-AttachVolumeTestJSON-919741929 tempest-AttachVolumeTestJSON-919741929-project] 10.222.0.17 "GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b" status: 404 len: 111 microversion: 2.1 time: 0.030029 Aug 06 20:47:27.900719 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 444/892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:27 2022] GET /compute/v2.1/servers/72752a0b-3b0b-428e-b578-4958b8a51a1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:27.931605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "552be489-fe14-4914-9101-b0fe37a365fa"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:27.935025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:27.942420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.942997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.943481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:27.944180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:27.944631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:27.945174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:28.284272 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-36c9409e-befe-4e33-bfa7-f6862f39d8a4 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "POST /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356643 Aug 06 20:47:28.289996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 449/893] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:47:27 2022] POST /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:28.637151 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:28.638371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:28.645809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:28.646530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:28.647159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:28.647978 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:28.648441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:28.648929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:28.877740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:28.885720 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:28.887851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:28.889253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-aa5cb7e8-b5b4-4d7c-b2e8-ed5c0e994fa8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.256653 Aug 06 20:47:28.889803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 445/894] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:28 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:29.914307 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:29.915022 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:29.922313 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:29.929917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:29.930745 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:29.932164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:29.933947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:29.936627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:30.219638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:30.230618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:30.233209 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:30.234593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-17b7fe15-5cb6-4a28-a966-0e30620c4bd0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.325637 Aug 06 20:47:30.247350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 450/895] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:29 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:31.266268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:31.266789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:31.273470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:31.273950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:31.274382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:31.275072 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:31.275555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:31.275987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:31.447667 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:31.459286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:31.460955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:31.462653 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7b7f900d-8a30-4d45-add1-a77e3075cb4e tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.200413 Aug 06 20:47:31.463698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 446/896] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:31 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:32.486770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:32.487531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:32.495338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:32.499946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:32.500420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:32.501201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:32.501754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:32.502202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:32.690876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:32.702232 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:32.704024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:32.705203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bc66a910-536d-4699-bd36-32a00e66878a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.222745 Aug 06 20:47:32.705841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 451/897] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:32 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:33.015823 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8ab90713-e66c-4e8f-8132-25c5f9e0b911 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Action: 'create', calling method: .version_select at 0x7fba95f69c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-27536256", "metadata": {"Type": "work"}}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:33.383489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8ab90713-e66c-4e8f-8132-25c5f9e0b911 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.486427 Aug 06 20:47:33.384111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 447/898] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 20:47:32 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 488 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 20:47:33.397074 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a6300301-5e15-4dcf-8299-ce32b188081d tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Calling method '.version_select at 0x7fba9582fd30>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:33.452915 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a6300301-5e15-4dcf-8299-ce32b188081d tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377" status: 200 len: 351 microversion: 2.1 time: 0.060093 Aug 06 20:47:33.453489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 452/899] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:47:33 2022] GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:33.728705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:33.729600 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:33.736558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:33.737041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:33.737471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:33.738164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:33.738611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:33.739221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:33.870070 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:33.879058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:33.881696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:33.883270 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2898c829-1fc0-439b-a866-f219fb372c5f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.158314 Aug 06 20:47:33.884052 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 448/900] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:33 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:34.466582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6ac8d55c-fdf6-4661-895b-5be5d2bb1dd6 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Calling method '.version_select at 0x7fba957bb430>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:34.516510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6ac8d55c-fdf6-4661-895b-5be5d2bb1dd6 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377" status: 200 len: 352 microversion: 2.1 time: 0.054121 Aug 06 20:47:34.517073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 453/901] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:47:34 2022] GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:34.529497 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-af4f7f8e-2219-4dec-88ac-380f950c7a6e tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Calling method '.version_select at 0x7fba95e35ca0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:34.585637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-af4f7f8e-2219-4dec-88ac-380f950c7a6e tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377" status: 200 len: 352 microversion: 2.1 time: 0.059900 Aug 06 20:47:34.598640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 449/902] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:47:34 2022] GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:34.604122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-af0e1499-3f3a-4446-9573-00d89df21c32 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Calling method '.version_select at 0x7fba9a836ca0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:34.666722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-af0e1499-3f3a-4446-9573-00d89df21c32 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377" status: 202 len: 0 microversion: 2.1 time: 0.066624 Aug 06 20:47:34.667416 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 454/903] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:47:34 2022] DELETE /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 20:47:34.676298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5e0536e3-7b17-4bb4-a02b-6a6f3ed281fa tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Calling method '.version_select at 0x7fba95e06040>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:34.726393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5e0536e3-7b17-4bb4-a02b-6a6f3ed281fa tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377" status: 200 len: 351 microversion: 2.1 time: 0.054086 Aug 06 20:47:34.727272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 450/904] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:47:34 2022] GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:34.907713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:34.908316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:34.914439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:34.914926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:34.915409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:34.916108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:34.916568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:34.916979 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:35.062051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:35.080115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:35.080115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:35.082057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-81d6b609-d9b7-4c99-ab66-898880edc639 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.177782 Aug 06 20:47:35.082057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 455/905] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:34 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:35.741014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bdf5ce88-6445-4e5f-8994-30606089dd20 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Calling method '.version_select at 0x7fba95e16820>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:35.781464 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-bdf5ce88-6445-4e5f-8994-30606089dd20 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] HTTP exception thrown: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bdf5ce88-6445-4e5f-8994-30606089dd20 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Request method failure captured: Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 HTTP/1.1 Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tNkOEWHSoi-E3cTyY01Qj5sLsFMGxP1CmCabhpu7QJU-1D9WICmpJiXRCjzFE1R1tO2E4ARiwl8lE8xH131M4rEbRyVaBwVqB4SSWDY8LQY5ivTQxHd0DaIU8lgYW8m4ZBYgdmSfzVahfid_woukyOlTMfvhtdiCc0vgU_2rpw78HI Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 5e799ebe607d415f86559db6f3a0b11a Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesGetTestJSON-1954122065 Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:35.784984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5e799ebe607d415f86559db6f3a0b11a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e799ebe607d415f86559db6f3a0b11a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5e799ebe607d415f86559db6f3a0b11a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5e799ebe607d415f86559db6f3a0b11a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesGetTestJSON-1954122065 Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 5e799ebe607d415f86559db6f3a0b11a Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesGetTestJSON-1954122065 Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesGetTestJSON-1954122065-project Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 5e640030f6f04164a14b315a87c906b5 Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesGetTestJSON-1954122065-project Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '8d31c6a6-efb8-476c-93ab-4869346a1377'} Aug 06 20:47:35.786394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. (HTTP 404) (Request-ID: req-221a1161-1759-4150-9c1f-9ef1ee2d88f8) Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:35.787335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:47:35.788627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 20:47:35.789834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bdf5ce88-6445-4e5f-8994-30606089dd20 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] Returning 404 to user: Volume 8d31c6a6-efb8-476c-93ab-4869346a1377 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:35.791000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bdf5ce88-6445-4e5f-8994-30606089dd20 tempest-VolumesGetTestJSON-1954122065 tempest-VolumesGetTestJSON-1954122065-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377" status: 404 len: 109 microversion: 2.1 time: 0.049967 Aug 06 20:47:35.792116 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 451/906] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:47:35 2022] GET /compute/v2.1/os-volumes/8d31c6a6-efb8-476c-93ab-4869346a1377 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:36.111839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:36.113130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:36.119981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:36.120898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:36.122152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:36.123041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:36.124042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:36.124638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:36.274215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:36.285434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:36.286995 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:36.288198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2f8280f1-2e5d-4a3d-af9d-5d5dc6ca5f50 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.180424 Aug 06 20:47:36.288956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 456/907] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:36 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:37.313496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:37.314280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:37.320535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:37.321342 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:37.322013 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:37.322952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:37.323665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:37.324338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:37.490750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:37.499775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:37.502238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:37.504006 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b5aca3bc-a372-4716-8924-fefa98577656 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.195531 Aug 06 20:47:37.504775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 452/908] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:37 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:38.526297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:38.526908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:38.534327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:38.534830 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:38.535289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:38.535994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:38.545530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:38.546087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:38.696609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:38.700439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:38.706502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:38.708878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:38.710605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-cee3548e-f912-4198-bd5f-cc214a8dd53a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.188257 Aug 06 20:47:38.722707 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 457/909] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:38 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:39.734045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:39.734678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:39.742505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:39.743014 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:39.743726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:39.744630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:39.745222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:39.745704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:39.884894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:39.900118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:39.902941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:39.904172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b89dedf7-3b88-4df5-b3bb-ba98e1c183bc tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.174495 Aug 06 20:47:39.904722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 453/910] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:39 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:40.927416 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:40.928036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:40.936486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:40.936982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:40.937421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:40.938126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:40.938586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:40.939017 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:41.073140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:41.082223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:41.083765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:41.084927 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-febdeaf1-272a-49c3-bef6-1c89f9dfb229 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.161794 Aug 06 20:47:41.085484 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 458/911] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:40 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:42.108723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:42.109498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:42.115696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:42.116287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:42.116840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:42.117541 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:42.118004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:42.118433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:42.266148 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:42.274107 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:42.275638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:42.276813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c64feb3c-d982-4dc8-86ad-edb9b284febe tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.172161 Aug 06 20:47:42.277363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 454/912] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:42 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:43.300172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:43.300779 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:43.306757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:43.307227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:43.307846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:43.308557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:43.309010 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:43.309432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:43.444940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:43.453770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:43.455379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:43.456607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c85e9b1e-6d29-43d8-bde9-213ac199ea8a tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.160251 Aug 06 20:47:43.457158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 459/913] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:43 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:44.480038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:44.480778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:44.488186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:44.488762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:44.489301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:44.490053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:44.490675 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:44.491100 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:44.506696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:44.631942 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:44.640495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:44.641981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:44.643183 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d0c2032a-2370-480c-9ac4-dfb133e4f589 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.167029 Aug 06 20:47:44.643756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 455/914] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:44 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:45.664760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:45.665436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:45.672460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:45.672951 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:45.673390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:45.674074 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:45.674535 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:45.674960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:45.803659 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:45.812491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:45.814158 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:45.815258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-bf2fadf2-0c8e-4c35-afd4-b23a7e749c78 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.154467 Aug 06 20:47:45.815810 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 460/915] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:45 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:46.638333 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:46.638818 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:46.646085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:46.646710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:46.647152 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:46.647896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:46.648354 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:46.648783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:46.733048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'services' on Instance uuid 93c207f3-a163-4286-9ed2-bad238be3153 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:47:46.807592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5b1383fa-f1f1-4b8f-9893-697682d97afd tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments/552be489-fe14-4914-9101-b0fe37a365fa" status: 202 len: 0 microversion: 2.1 time: 0.173050 Aug 06 20:47:46.808350 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 456/916] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:47:46 2022] DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments/552be489-fe14-4914-9101-b0fe37a365fa => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:47:46.816542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:46.819459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:46.826431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:46.826946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:46.827522 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:46.828405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:46.829049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:46.829488 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:46.841190 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:46.841888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:46.848728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:46.849220 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:46.850259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:46.850959 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:46.851793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:46.852651 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:46.866453 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2d2ec3dc-c5f7-4d2c-b7c8-d2cdd064f0f9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053836 Aug 06 20:47:46.867326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 461/917] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:47:46 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:47.031901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:47.041323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:47.043465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:47.044638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d32012ae-7aeb-462e-a460-74fbf94bf80f tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.209903 Aug 06 20:47:47.055079 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 457/918] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:46 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:47.879037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:47.881816 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:47.889058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:47.889592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:47.890071 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:47.890783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:47.891487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:47.892328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:47.927407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1a67f19a-2e62-47bb-abd5-7f711575e585 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052633 Aug 06 20:47:47.928885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 462/919] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:47:47 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:47:48.001624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:48.002928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:48.010449 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.011218 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.012597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.013494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.013945 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.014603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.040312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:47:48.044402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-8935ba0c-6f9e-469c-b9e8-c765b17ac64e req-6afa04a5-4fce-4b1f-be90-bdeae93016ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "name": "network-vif-plugged", "status": "completed", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:48.054892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-8935ba0c-6f9e-469c-b9e8-c765b17ac64e req-6afa04a5-4fce-4b1f-be90-bdeae93016ca service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.055332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-8935ba0c-6f9e-469c-b9e8-c765b17ac64e req-6afa04a5-4fce-4b1f-be90-bdeae93016ca service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.055977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-8935ba0c-6f9e-469c-b9e8-c765b17ac64e req-6afa04a5-4fce-4b1f-be90-bdeae93016ca service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.071538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-8935ba0c-6f9e-469c-b9e8-c765b17ac64e req-6afa04a5-4fce-4b1f-be90-bdeae93016ca service nova] Creating event network-vif-plugged:6fd7b112-713c-4645-9ef1-dadf3f856ec4 for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 on hv-cinder-85199 Aug 06 20:47:48.077500 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-8935ba0c-6f9e-469c-b9e8-c765b17ac64e req-6afa04a5-4fce-4b1f-be90-bdeae93016ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037802 Aug 06 20:47:48.078621 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 463/920] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:47:48.084184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:48.085261 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:48.093585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.094504 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.095354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.096601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.097745 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.098442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.138353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4579c9d1-f69e-44c4-b45c-0b6ffaa24c4c tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 204 len: 0 microversion: 2.1 time: 0.140908 Aug 06 20:47:48.138933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 458/921] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:47 2022] DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:47:48.153471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:48.154180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:48.162747 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.163326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.163754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.164453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:48.164905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:48.165331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:48.608417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:48.613154 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:48.622234 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:48.623912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9ef7ab7d-e12b-4f10-a63d-9e6b8fcde5aa tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1681 microversion: 2.1 time: 0.479391 Aug 06 20:47:48.624335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:48.624492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 459/922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:48 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1681 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:48.638525 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c4e74f64-5d68-4644-96b4-c83fb235e402 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.558529 Aug 06 20:47:48.639208 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 464/923] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:48 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:49.644477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:49.645088 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:49.651587 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:49.652628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:49.653292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:49.654405 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:49.654940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:49.656973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:49.663137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:49.663821 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:49.670930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:49.671632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:49.672065 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:49.672765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:49.673218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:49.673634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:49.876113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:49.880187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:49.883835 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e8f44f23-da07-4dd5-8590-cf1cfb111a5a tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1681 microversion: 2.1 time: 0.243236 Aug 06 20:47:49.884486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 460/924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:49 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:49.888132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:49.889786 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:49.890960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-609b97b1-ced6-4493-a9ec-86a088080594 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.232507 Aug 06 20:47:49.891539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 465/925] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:49 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:50.093778 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1894861992", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "networks": [{"uuid": "f670e242-a65e-44d7-a41f-360c5a448e24"}]}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:50.101769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:50.146507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] validate_networks() for [('f670e242-a65e-44d7-a41f-360c5a448e24', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:47:50.506338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:47:50.506756 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:47:50.507221 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:47:50.507653 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:47:50.508058 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:47:50.516741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:50.517214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:50.517645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:50.518360 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:50.518810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:50.519228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:50.536020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Getting quotas for project e3959e559ae642e88844b20c26cc39d5. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:47:50.539868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Getting quotas for user 2b066fface374ff0bc373f7a06a7233a and project e3959e559ae642e88844b20c26cc39d5. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:47:50.550944 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:47:50.553176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:47:50.601524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c4fbdd44-8f4e-4114-80fc-37151946e25e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512075 Aug 06 20:47:50.602487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 461/926] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:47:50.613564 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6b502885-b774-4cd5-b361-8a4261c086e8 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:50.614258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6b502885-b774-4cd5-b361-8a4261c086e8 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:50.677947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6b502885-b774-4cd5-b361-8a4261c086e8 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:50.684754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6b502885-b774-4cd5-b361-8a4261c086e8 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1214 microversion: 2.1 time: 0.074970 Aug 06 20:47:50.685328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 466/927] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:50 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:50.909040 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:50.910875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:50.913680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:50.914364 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:50.920572 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:50.921048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:50.921537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:50.922198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:50.922847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:50.923487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:50.924248 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:50.924635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:50.924781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:50.925152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:50.925282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:50.925764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:51.228960 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:51.237071 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:51.243132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3d3f3732-f3ad-443e-95b4-e00416bec414 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1681 microversion: 2.1 time: 0.341434 Aug 06 20:47:51.248367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:51.249889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:51.251072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-cf1ffab1-b4bb-49db-8ec4-c5ad74890d99 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.341413 Aug 06 20:47:51.251971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 462/928] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:50 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:51.263938 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 467/929] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:50 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:51.705298 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:51.705920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:51.714352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:51.714822 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:51.715283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:51.716534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:51.717002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:51.717470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:51.802607 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:51.811793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c370401f-33ae-4e38-9a31-3965750cf5c4 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1266 microversion: 2.1 time: 0.110394 Aug 06 20:47:51.812379 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 463/930] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:51 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:51.888741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-66034426-ca10-400c-8eb2-f92a4456abe2 req-6c792439-f206-4f54-86d4-4ca3fa95bd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c207f3-a163-4286-9ed2-bad238be3153", "name": "network-vif-deleted", "tag": "2f97141f-72f8-4002-8ace-daf7d0f53969"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:51.896567 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:51.904591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-66034426-ca10-400c-8eb2-f92a4456abe2 req-6c792439-f206-4f54-86d4-4ca3fa95bd5b service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:51.905211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-66034426-ca10-400c-8eb2-f92a4456abe2 req-6c792439-f206-4f54-86d4-4ca3fa95bd5b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:51.905852 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-66034426-ca10-400c-8eb2-f92a4456abe2 req-6c792439-f206-4f54-86d4-4ca3fa95bd5b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:51.923402 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-66034426-ca10-400c-8eb2-f92a4456abe2 req-6c792439-f206-4f54-86d4-4ca3fa95bd5b service nova] Creating event network-vif-deleted:2f97141f-72f8-4002-8ace-daf7d0f53969 for instance 93c207f3-a163-4286-9ed2-bad238be3153 on hv-cinder-85199 Aug 06 20:47:51.931006 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-66034426-ca10-400c-8eb2-f92a4456abe2 req-6c792439-f206-4f54-86d4-4ca3fa95bd5b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Aug 06 20:47:51.932117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 468/931] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:52.277938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:52.278735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:52.288470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.289353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.290252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:52.297859 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:52.299041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:52.305927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.312888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.314699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:52.317799 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.324529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.325311 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:52.331084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.331711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.332417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:52.378636 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.379330 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.379873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:52.380443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lazy-loading 'fault' on Instance uuid 93c207f3-a163-4286-9ed2-bad238be3153 {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:47:52.450956 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a58d55f9cc42c7a041884eee0ea248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a036d3083bb4055a3aed77a698b2c3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:52.460025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bbbeeb8c-59ad-4722-ba84-7a1abcb378b1 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 200 len: 1332 microversion: 2.1 time: 0.186056 Aug 06 20:47:52.461468 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 464/932] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:52 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 1332 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:52.536992 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:52.549759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:52.552080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:52.553235 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-23ac960f-5176-408e-9721-001572427975 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1729 microversion: 2.20 time: 0.261166 Aug 06 20:47:52.567447 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 469/933] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:52 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1729 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 20:47:52.832706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:52.833352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:52.839787 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.840523 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.840967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:52.842712 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:52.843178 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:52.843636 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:53.231704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:53.239183 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-e52b8ebe-5938-4f8d-8dbb-6b9082c66543 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.410716 Aug 06 20:47:53.239773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 465/934] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:52 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:47:53.482708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:53.483380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:53.489884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:53.490370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:53.490839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:53.491565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:53.492025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:53.492449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:53.505538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 HTTP/1.1 Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:53.507171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:53.508732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '93c207f3-a163-4286-9ed2-bad238be3153'} Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:53.509471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:53.510694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:53.511812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:53.511812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4797cc70-3057-4e5f-b404-cebbc9ecc110 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 404 len: 111 microversion: 2.1 time: 0.030547 Aug 06 20:47:53.511812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 470/935] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:53 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:53.517828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c6af9b64-c3dc-41af-b1dc-840603a81b04 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '.version_select at 0x7fba95ddec10>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:53.536476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c6af9b64-c3dc-41af-b1dc-840603a81b04 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435864883" status: 202 len: 0 microversion: 2.1 time: 0.022398 Aug 06 20:47:53.537133 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 466/936] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 20:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435864883 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:47:53.576725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:53.577602 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:53.585418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:53.586141 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:53.587037 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:53.588046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:53.588500 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:53.588932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:53.828546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:53.838693 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:53.840394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:53.841558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-28159b3b-3e80-4ff5-8b73-38e9707eabb8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1716 microversion: 2.20 time: 0.268836 Aug 06 20:47:53.843453 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 471/937] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:47:53 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1716 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:47:53.960309 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-cdc7027d-5e6c-4148-a7e2-f74a24655723 req-a9beb6c5-ab97-4b72-8994-0deaadce6eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbaaf82-49eb-49ff-b538-49635ffdbf48", "tag": "daf318da-5b46-49b6-82db-f4a99845466a"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:47:53.971865 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-cdc7027d-5e6c-4148-a7e2-f74a24655723 req-a9beb6c5-ab97-4b72-8994-0deaadce6eae service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:53.972649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-cdc7027d-5e6c-4148-a7e2-f74a24655723 req-a9beb6c5-ab97-4b72-8994-0deaadce6eae service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:53.973323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-cdc7027d-5e6c-4148-a7e2-f74a24655723 req-a9beb6c5-ab97-4b72-8994-0deaadce6eae service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:53.986272 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-cdc7027d-5e6c-4148-a7e2-f74a24655723 req-a9beb6c5-ab97-4b72-8994-0deaadce6eae service nova] Creating event network-changed:daf318da-5b46-49b6-82db-f4a99845466a for instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 on hv-cinder-85199 Aug 06 20:47:53.992915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-cdc7027d-5e6c-4148-a7e2-f74a24655723 req-a9beb6c5-ab97-4b72-8994-0deaadce6eae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038895 Aug 06 20:47:53.993750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 467/938] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:47:54.260405 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:54.261031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:54.269618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:54.270242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:54.270753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:54.271581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:54.272114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:54.272627 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:54.474397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:54.482486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-027c786c-88db-44f0-b6c2-9ff1669b8177 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.225887 Aug 06 20:47:54.483057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 472/939] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:54 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:55.340042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:55.340655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:55.347115 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:55.347643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:55.348084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:55.348776 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:55.349265 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:55.349691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:55.362645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 HTTP/1.1 Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:55.364286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.365707 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '93c207f3-a163-4286-9ed2-bad238be3153'} Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:55.366443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.368015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.369518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:55.369518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4f4e393d-ea0d-4716-9097-636088440406 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 404 len: 111 microversion: 2.1 time: 0.030703 Aug 06 20:47:55.369518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 468/940] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:55 2022] DELETE /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:55.373957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:55.374572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 93c207f3-a163-4286-9ed2-bad238be3153] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:55.381020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:55.381509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:55.381946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:55.382634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:55.383091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:55.383542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:55.397099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 HTTP/1.1 Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:55.398588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.400128 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '93c207f3-a163-4286-9ed2-bad238be3153'} Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:55.401117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. Aug 06 20:47:55.403370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:55.404878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 93c207f3-a163-4286-9ed2-bad238be3153 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:55.404878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c111c628-3f63-4e31-90d1-0ef0d4500942 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153" status: 404 len: 111 microversion: 2.1 time: 0.029830 Aug 06 20:47:55.404878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 473/941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:55 2022] GET /compute/v2.1/servers/93c207f3-a163-4286-9ed2-bad238be3153 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:55.502794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:55.503545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:55.509741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:55.510231 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:55.510722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:55.511500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:55.511959 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:55.512388 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:55.643459 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:55.650896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-38a00748-a04e-4b3f-9803-f1791bc54981 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.151985 Aug 06 20:47:55.651486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 469/942] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:55 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:56.536823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:56.537316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:56.544239 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.544719 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.545151 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.545837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.546286 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.546708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.561409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 HTTP/1.1 Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:56.562914 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.564382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': 'edade601-e01d-4bf7-ab7e-f9f48c518314'} Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:56.565132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.566318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.567592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:56.567592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c2fbcf71-f3ae-4bec-8d7b-cfac2b4b309f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 404 len: 111 microversion: 2.1 time: 0.031287 Aug 06 20:47:56.567592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 474/943] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:56 2022] DELETE /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:56.572640 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:56.573252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: edade601-e01d-4bf7-ab7e-f9f48c518314] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:56.579608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.580094 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.580530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.581222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.581674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.582096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.595838 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 HTTP/1.1 Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:56.597335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.598648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': 'edade601-e01d-4bf7-ab7e-f9f48c518314'} Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:56.599427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. Aug 06 20:47:56.600901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.602258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance edade601-e01d-4bf7-ab7e-f9f48c518314 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:56.602258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-00b3f911-549f-4eea-b76e-a270370655c9 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314" status: 404 len: 111 microversion: 2.1 time: 0.029890 Aug 06 20:47:56.602258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 470/944] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:56 2022] GET /compute/v2.1/servers/edade601-e01d-4bf7-ab7e-f9f48c518314 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:56.607826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:56.608317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:56.614160 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.614670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.615103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.615822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.616277 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.616696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.629613 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 HTTP/1.1 Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:56.631136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.632657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '70795577-6b17-4729-9500-c1f804c6e525'} Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:56.633674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.635285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.636920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:56.636920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e7d44d76-2199-409a-9c1b-45575d03773f tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 404 len: 111 microversion: 2.1 time: 0.029276 Aug 06 20:47:56.636920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 475/945] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:56 2022] DELETE /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:56.640648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:56.641256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 70795577-6b17-4729-9500-c1f804c6e525] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:56.647045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.647569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.648005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.648687 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.649138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.649558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.662850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 HTTP/1.1 Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:56.664349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.665907 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '70795577-6b17-4729-9500-c1f804c6e525'} Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:56.666854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. Aug 06 20:47:56.668428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:56.669704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 70795577-6b17-4729-9500-c1f804c6e525 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:56.669704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b93a3884-4596-49f1-804f-9b885bfbde3d tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525" status: 404 len: 111 microversion: 2.1 time: 0.028789 Aug 06 20:47:56.669704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 471/946] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:56 2022] GET /compute/v2.1/servers/70795577-6b17-4729-9500-c1f804c6e525 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:56.675133 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:56.675777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:56.684098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.684590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.685029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.685731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:56.686185 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:56.686612 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:56.906147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:56.913596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0f7b33cf-90d5-4a8e-9da5-ea43dbc43322 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.242357 Aug 06 20:47:56.914150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 476/947] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:56 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:47:57.815758 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:57.816264 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:57.822512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:57.822992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:57.823481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:57.824201 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:57.824653 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:57.825075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:57.838186 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 HTTP/1.1 Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:47:57.839711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.841149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '46acb22e-5b82-4d53-adae-81e616c05c32'} Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:57.842018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.843627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.845160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:57.845160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-468b4e0c-6204-45f5-9344-534ddd720c03 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 404 len: 111 microversion: 2.1 time: 0.029073 Aug 06 20:47:57.845160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 472/948] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:47:57 2022] DELETE /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:57.849188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:57.849795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] [instance: 46acb22e-5b82-4d53-adae-81e616c05c32] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:57.856689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:57.857107 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:57.857538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:57.858287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:57.858736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:57.859156 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:57.872774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] HTTP exception thrown: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Request method failure captured: Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 HTTP/1.1 Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tEGL18foeeAsTqsKLPPHfZVwwiLf1g3ZAXicOEgiHyOW12PYuVHFMHHedhHRylz1sTloqwfYNyzjZblHziZ748xUsSHWQpAciz-K4qKUmI-Gr9b77BzikGu3sL9pXzu4lr2dan46u6zp_Hl0lg-31t_vODEWGf-MOJjd6pJz9L0-To Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:47:57.874359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a036d3083bb4055a3aed77a698b2c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 2a036d3083bb4055a3aed77a698b2c3b Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2079271285 Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 28a58d55f9cc42c7a041884eee0ea248 Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeNegativeTest-2079271285-project Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.875943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '46acb22e-5b82-4d53-adae-81e616c05c32'} Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:47:57.876962 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. Aug 06 20:47:57.878403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:47:57.880016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] Returning 404 to user: Instance 46acb22e-5b82-4d53-adae-81e616c05c32 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:47:57.880016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-edac0698-238b-41c3-8bb8-8ca4af319ea5 tempest-AttachVolumeNegativeTest-2079271285 tempest-AttachVolumeNegativeTest-2079271285-project] 10.222.0.17 "GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32" status: 404 len: 111 microversion: 2.1 time: 0.030402 Aug 06 20:47:57.880016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 477/949] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:57 2022] GET /compute/v2.1/servers/46acb22e-5b82-4d53-adae-81e616c05c32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:57.933689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:57.934302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:57.945238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:57.945238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:57.945238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:57.945494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:57.945922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:57.946596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:58.087125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:58.096022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-665bb0b7-287d-4481-a029-b43d00d6070d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.165989 Aug 06 20:47:58.097230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 473/950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:57 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:47:59.117976 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:47:59.118591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:47:59.126801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:59.127327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:59.127772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:59.128482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:47:59.128943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:47:59.129442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:47:59.262047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:47:59.269718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3086ab32-025b-4446-b623-7003eb932e61 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.155597 Aug 06 20:47:59.270433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 478/951] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:47:59 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:00.254871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-d18d6cb6-56c4-4ba2-bbb8-2181d1d7fffb req-26b17c58-d92d-48ba-b2c0-446b1654c901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbaaf82-49eb-49ff-b538-49635ffdbf48", "name": "network-vif-plugged", "status": "completed", "tag": "daf318da-5b46-49b6-82db-f4a99845466a"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:00.264740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-d18d6cb6-56c4-4ba2-bbb8-2181d1d7fffb req-26b17c58-d92d-48ba-b2c0-446b1654c901 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:00.265222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-d18d6cb6-56c4-4ba2-bbb8-2181d1d7fffb req-26b17c58-d92d-48ba-b2c0-446b1654c901 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:00.265653 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-d18d6cb6-56c4-4ba2-bbb8-2181d1d7fffb req-26b17c58-d92d-48ba-b2c0-446b1654c901 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:00.276283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-d18d6cb6-56c4-4ba2-bbb8-2181d1d7fffb req-26b17c58-d92d-48ba-b2c0-446b1654c901 service nova] Creating event network-vif-plugged:daf318da-5b46-49b6-82db-f4a99845466a for instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 on hv-cinder-85199 Aug 06 20:48:00.281596 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-d18d6cb6-56c4-4ba2-bbb8-2181d1d7fffb req-26b17c58-d92d-48ba-b2c0-446b1654c901 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158057 Aug 06 20:48:00.282191 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 474/952] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:48:00.290739 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:00.291385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:00.298326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:00.298754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:00.299193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:00.299919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:00.300378 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:00.300807 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:00.535909 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:00.544239 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-73305c9e-0d93-46db-9aab-ddeb39bc6f2e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.257214 Aug 06 20:48:00.544826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 479/953] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:00 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:01.561905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:01.562695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:01.567237 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:01.568096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:01.575899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:01.576393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:01.577103 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:01.577535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:01.578118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:01.578562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:01.582761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:01.727067 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:01.735268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6a2dbe08-3d6e-4971-827d-b78fc1a3285c tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1314 microversion: 2.1 time: 0.174185 Aug 06 20:48:01.739398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 475/954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:01 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:02.347980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:02.461457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8b25643a-5412-4e66-b65a-aee45fb3d3f6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Action: 'create', calling method: .version_select at 0x7fba958e9670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-228748855", "metadata": {"Type": "work"}}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8b25643a-5412-4e66-b65a-aee45fb3d3f6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Request method failure captured: Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 121 Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tOC-tZgDWeuAsPYxRAAD0IstPQooHiVcIqLLpHZYbS8nr97kDUOBn9s8sIrrsCgBi9HZFA1kseKlz9Ld742fW_-kfrTw_-fVmlc1dY9oeTq__1_OEFBbgjtLJ3jbI1GXgm1nPkPCao9suBgFhwy8j93IGtPPKx2HZA6VlvMkXEYJyY Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:48:02.470804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 15f03a49687745cdaba51d5b324138a4 Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-228748855", "metadata": {"Type": "work"}}} Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: Aug 06 20:48:02.472459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-228748855', 'metadata': {'Type': 'work'}}}} Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi '#$%' Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:02.473433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:48:02.474994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:48:02.476258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 20:48:02.476258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.476258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8b25643a-5412-4e66-b65a-aee45fb3d3f6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:02.476258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8b25643a-5412-4e66-b65a-aee45fb3d3f6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128972 Aug 06 20:48:02.476258 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 480/955] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 20:48:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 06 20:48:02.482784 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-20ef0092-8f83-4f0c-8fac-c8ac9e205ad6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Action: 'create', calling method: .version_select at 0x7fba95e2c5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-958924320", "metadata": {"Type": "work"}}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-20ef0092-8f83-4f0c-8fac-c8ac9e205ad6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Request method failure captured: Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 119 Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tOC-tZgDWeuAsPYxRAAD0IstPQooHiVcIqLLpHZYbS8nr97kDUOBn9s8sIrrsCgBi9HZFA1kseKlz9Ld742fW_-kfrTw_-fVmlc1dY9oeTq__1_OEFBbgjtLJ3jbI1GXgm1nPkPCao9suBgFhwy8j93IGtPPKx2HZA6VlvMkXEYJyY Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:48:02.487477 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 15f03a49687745cdaba51d5b324138a4 Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-958924320", "metadata": {"Type": "work"}}} Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:48:02.489096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-958924320', 'metadata': {'Type': 'work'}}}} Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi '0' Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:02.490182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:48:02.492312 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:48:02.493594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 20:48:02.493594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.493594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-20ef0092-8f83-4f0c-8fac-c8ac9e205ad6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:02.493594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-20ef0092-8f83-4f0c-8fac-c8ac9e205ad6 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010597 Aug 06 20:48:02.493594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 476/956] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 20:48:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:48:02.498849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9382ec40-5e41-4e99-98e8-c8f674d6ed92 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Action: 'create', calling method: .version_select at 0x7fba957bb280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-351653124", "metadata": {"Type": "work"}}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9382ec40-5e41-4e99-98e8-c8f674d6ed92 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Request method failure captured: Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 118 Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tOC-tZgDWeuAsPYxRAAD0IstPQooHiVcIqLLpHZYbS8nr97kDUOBn9s8sIrrsCgBi9HZFA1kseKlz9Ld742fW_-kfrTw_-fVmlc1dY9oeTq__1_OEFBbgjtLJ3jbI1GXgm1nPkPCao9suBgFhwy8j93IGtPPKx2HZA6VlvMkXEYJyY Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:48:02.503385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 15f03a49687745cdaba51d5b324138a4 Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-351653124", "metadata": {"Type": "work"}}} Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: Aug 06 20:48:02.505442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-351653124', 'metadata': {'Type': 'work'}}}} Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise error Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi '' Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:02.506566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 20:48:02.508545 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 20:48:02.509896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 20:48:02.509896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.509896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9382ec40-5e41-4e99-98e8-c8f674d6ed92 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:02.509896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9382ec40-5e41-4e99-98e8-c8f674d6ed92 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010775 Aug 06 20:48:02.509896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 481/957] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 20:48:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:48:02.515936 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-55a901ff-0f57-4373-8f09-8ed214f4e057 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Calling method '.version_select at 0x7fba95e169d0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:02.544215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-55a901ff-0f57-4373-8f09-8ed214f4e057 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] HTTP exception thrown: Volume tempest-invalid-1309368411 could not be found. Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-55a901ff-0f57-4373-8f09-8ed214f4e057 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Request method failure captured: Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1309368411 HTTP/1.1 Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tOC-tZgDWeuAsPYxRAAD0IstPQooHiVcIqLLpHZYbS8nr97kDUOBn9s8sIrrsCgBi9HZFA1kseKlz9Ld742fW_-kfrTw_-fVmlc1dY9oeTq__1_OEFBbgjtLJ3jbI1GXgm1nPkPCao9suBgFhwy8j93IGtPPKx2HZA6VlvMkXEYJyY Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:48:02.546941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 15f03a49687745cdaba51d5b324138a4 Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Volume tempest-invalid-1309368411 could not be found. Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': 'tempest-invalid-1309368411'} Aug 06 20:48:02.548630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1309368411 could not be found. (HTTP 404) (Request-ID: req-99f65c5b-0afa-4b25-bc98-1d03b3f9feb0) Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.549506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 20:48:02.550891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1309368411 could not be found. Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:48:02.552411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1309368411 could not be found. Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1309368411 could not be found. Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-55a901ff-0f57-4373-8f09-8ed214f4e057 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Returning 404 to user: Volume tempest-invalid-1309368411 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-55a901ff-0f57-4373-8f09-8ed214f4e057 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1309368411" status: 404 len: 99 microversion: 2.1 time: 0.036305 Aug 06 20:48:02.553958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 477/958] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Aug 6 20:48:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1309368411 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 20:48:02.558835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5f1d720b-4281-43b8-9a61-034f6d43f260 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003842 Aug 06 20:48:02.559363 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 482/959] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Aug 6 20:48:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 06 20:48:02.568096 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-93f9d79e-11b2-4967-8068-a3121f919a25 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004137 Aug 06 20:48:02.568611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 478/960] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Aug 6 20:48:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 20:48:02.576762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-14396068-31ca-4d73-a14c-47e216e88d53 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Calling method '.version_select at 0x7fba957bb280>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:02.606067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-14396068-31ca-4d73-a14c-47e216e88d53 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] HTTP exception thrown: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-14396068-31ca-4d73-a14c-47e216e88d53 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Request method failure captured: Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/os-volumes/467448ad-c498-429a-bc45-d307f6f61d50 HTTP/1.1 Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tOC-tZgDWeuAsPYxRAAD0IstPQooHiVcIqLLpHZYbS8nr97kDUOBn9s8sIrrsCgBi9HZFA1kseKlz9Ld742fW_-kfrTw_-fVmlc1dY9oeTq__1_OEFBbgjtLJ3jbI1GXgm1nPkPCao9suBgFhwy8j93IGtPPKx2HZA6VlvMkXEYJyY Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:48:02.609237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 15f03a49687745cdaba51d5b324138a4 Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '467448ad-c498-429a-bc45-d307f6f61d50'} Aug 06 20:48:02.610740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. (HTTP 404) (Request-ID: req-51af835b-b8b0-49ca-ae87-b47fe9f84ac9) Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.612387 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 20:48:02.613757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 20:48:02.614886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-14396068-31ca-4d73-a14c-47e216e88d53 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Returning 404 to user: Volume 467448ad-c498-429a-bc45-d307f6f61d50 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-14396068-31ca-4d73-a14c-47e216e88d53 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/467448ad-c498-429a-bc45-d307f6f61d50" status: 404 len: 109 microversion: 2.1 time: 0.037548 Aug 06 20:48:02.616115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 483/961] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:48:02 2022] DELETE /compute/v2.1/os-volumes/467448ad-c498-429a-bc45-d307f6f61d50 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:48:02.620752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-255bb6f4-a62c-4075-b572-71a8df096048 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Calling method '.version_select at 0x7fba95e94d30>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:02.647537 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-255bb6f4-a62c-4075-b572-71a8df096048 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] HTTP exception thrown: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-255bb6f4-a62c-4075-b572-71a8df096048 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Request method failure captured: Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/os-volumes/57eaed08-00af-4187-a281-bdfc7b8ab670 HTTP/1.1 Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tOC-tZgDWeuAsPYxRAAD0IstPQooHiVcIqLLpHZYbS8nr97kDUOBn9s8sIrrsCgBi9HZFA1kseKlz9Ld742fW_-kfrTw_-fVmlc1dY9oeTq__1_OEFBbgjtLJ3jbI1GXgm1nPkPCao9suBgFhwy8j93IGtPPKx2HZA6VlvMkXEYJyY Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:48:02.649494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/33e71f1aa46e4f4fbc5f6774d95322ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 33e71f1aa46e4f4fbc5f6774d95322ac Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesNegativeTest-469335163 Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 15f03a49687745cdaba51d5b324138a4 Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesNegativeTest-469335163-project Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '57eaed08-00af-4187-a281-bdfc7b8ab670'} Aug 06 20:48:02.651137 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. (HTTP 404) (Request-ID: req-dc27afbc-2058-4085-838e-4a51082e3d4e) Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.652584 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:48:02.653813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 20:48:02.654921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-255bb6f4-a62c-4075-b572-71a8df096048 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] Returning 404 to user: Volume 57eaed08-00af-4187-a281-bdfc7b8ab670 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-255bb6f4-a62c-4075-b572-71a8df096048 tempest-VolumesNegativeTest-469335163 tempest-VolumesNegativeTest-469335163-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/57eaed08-00af-4187-a281-bdfc7b8ab670" status: 404 len: 109 microversion: 2.1 time: 0.034099 Aug 06 20:48:02.656061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 479/962] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:48:02 2022] GET /compute/v2.1/os-volumes/57eaed08-00af-4187-a281-bdfc7b8ab670 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:48:02.756233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:02.757031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:02.764531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:02.765180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:02.765589 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:02.766303 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:02.766793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:02.767201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:02.772287 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:03.156096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:03.165149 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7cf4439c-6f42-49c7-8053-ee9b6e8e8102 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1497 microversion: 2.1 time: 0.412760 Aug 06 20:48:03.175593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 484/963] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:02 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1497 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:03.707924 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:03.708365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:03.716077 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:03.716598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:03.717004 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:03.717706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:03.718166 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:03.718595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:03.743266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:48:03.822867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-35b55f67-ab9a-4f98-96a1-c4fd05967ee6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 204 len: 0 microversion: 2.1 time: 0.121405 Aug 06 20:48:03.823682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 480/964] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:48:03 2022] DELETE /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:48:03.833144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:03.833733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:03.840460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:03.840951 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:03.841385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:03.842086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:03.842539 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:03.842966 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:03.975855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:03.983981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-648fbe7b-e752-4b67-a3ff-90e5e06d3869 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1503 microversion: 2.1 time: 0.155793 Aug 06 20:48:03.984540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 485/965] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:03 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:48:05.004669 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:05.005361 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:05.012318 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:05.012948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:05.013320 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:05.014212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:05.014703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:05.015175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:05.151521 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:05.158891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-53b3e6ce-bd26-4ab7-a28b-5d7b0e5918a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1503 microversion: 2.1 time: 0.158359 Aug 06 20:48:05.159490 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 481/966] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:04 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:06.180350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:06.181019 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:06.190284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:06.190615 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:06.191049 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:06.191780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:06.192233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:06.192652 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:06.239457 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-503606f0-52bc-4498-9ad4-1d216ba7e63a req-35a6965f-a8ea-49c1-9382-6c5e37d286c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbaaf82-49eb-49ff-b538-49635ffdbf48", "name": "network-vif-deleted", "tag": "daf318da-5b46-49b6-82db-f4a99845466a"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:06.252880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-503606f0-52bc-4498-9ad4-1d216ba7e63a req-35a6965f-a8ea-49c1-9382-6c5e37d286c8 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:06.253363 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-503606f0-52bc-4498-9ad4-1d216ba7e63a req-35a6965f-a8ea-49c1-9382-6c5e37d286c8 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:06.253793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-503606f0-52bc-4498-9ad4-1d216ba7e63a req-35a6965f-a8ea-49c1-9382-6c5e37d286c8 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:06.266165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-503606f0-52bc-4498-9ad4-1d216ba7e63a req-35a6965f-a8ea-49c1-9382-6c5e37d286c8 service nova] Creating event network-vif-deleted:daf318da-5b46-49b6-82db-f4a99845466a for instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 on hv-cinder-85199 Aug 06 20:48:06.270856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:06.272651 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-503606f0-52bc-4498-9ad4-1d216ba7e63a req-35a6965f-a8ea-49c1-9382-6c5e37d286c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038295 Aug 06 20:48:06.273328 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 482/967] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:48:06.282242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c879121f-fcf7-490e-82cb-ac35f136ef94 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 200 len: 1461 microversion: 2.1 time: 0.105954 Aug 06 20:48:06.282819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 486/968] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:06 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 1461 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:07.303897 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:07.304779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: bfbaaf82-49eb-49ff-b538-49635ffdbf48] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:07.310762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:07.311263 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:07.311712 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:07.312399 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:07.312850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:07.313280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:07.330986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] HTTP exception thrown: Instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 could not be found. Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Request method failure captured: Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 HTTP/1.1 Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tN0O3H1aeembJbAWA0VzsiBUqne1ORAq7mSzHYUu7adcb9FY0wibzlH6K0673HKxryPMKk5NpH__DZUaYg-M5gGQ51hiu1U1s1kuwza6Vc2_SRHbQFz1L99cmz1iVmF4KVwa7GyPTSNYT0uXbR0EqkeZTrLgjm3LdqiBSRMyoqF9rE Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: e3959e559ae642e88844b20c26cc39d5 Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesActionsTest-659813618 Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:48:07.332759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesActionsTest-659813618 Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: e3959e559ae642e88844b20c26cc39d5 Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesActionsTest-659813618 Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesActionsTest-659813618-project Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 2b066fface374ff0bc373f7a06a7233a Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesActionsTest-659813618-project Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 could not be found. Aug 06 20:48:07.334795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': 'bfbaaf82-49eb-49ff-b538-49635ffdbf48'} Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 could not be found. Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:07.335985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 could not be found. Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 could not be found. Aug 06 20:48:07.337739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:07.340546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Returning 404 to user: Instance bfbaaf82-49eb-49ff-b538-49635ffdbf48 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:07.340546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4071c256-502a-4e79-bee9-afa5f0bb3a09 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48" status: 404 len: 111 microversion: 2.1 time: 0.035006 Aug 06 20:48:07.340546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 483/969] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:07 2022] GET /compute/v2.1/servers/bfbaaf82-49eb-49ff-b538-49635ffdbf48 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:48:07.452457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-332216625", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452", "networks": [{"uuid": "f670e242-a65e-44d7-a41f-360c5a448e24"}]}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:07.504998 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] validate_networks() for [('f670e242-a65e-44d7-a41f-360c5a448e24', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:48:07.872390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:48:07.872891 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:48:07.873584 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:48:07.874005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:48:07.874422 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:48:07.883328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:07.883819 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:07.884261 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:07.884996 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:07.885456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:07.886426 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:07.903924 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Getting quotas for project e3959e559ae642e88844b20c26cc39d5. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:48:07.908020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Getting quotas for user 2b066fface374ff0bc373f7a06a7233a and project e3959e559ae642e88844b20c26cc39d5. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:48:07.924472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:48:07.928118 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:48:07.985363 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fadae56b-88f5-4697-ac71-97b7255ac6ff tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537781 Aug 06 20:48:07.985957 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 487/970] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:48:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:48:07.998875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-36132ea9-c5b4-40c8-b0ac-c74acfaea9a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:07.999773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-36132ea9-c5b4-40c8-b0ac-c74acfaea9a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:08.064882 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-36132ea9-c5b4-40c8-b0ac-c74acfaea9a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:08.073832 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-36132ea9-c5b4-40c8-b0ac-c74acfaea9a9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1213 microversion: 2.1 time: 0.080801 Aug 06 20:48:08.074804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 484/971] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:07 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:09.095839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:09.097210 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:09.107012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:09.108376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:09.109129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:09.110102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:09.110959 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:09.111783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:09.185864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:09.194664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-becc2bde-fe11-48ec-a9a6-2bdcfdd56915 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1265 microversion: 2.1 time: 0.102457 Aug 06 20:48:09.195342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 488/972] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:09 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:10.216860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:10.217694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:10.225370 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:10.226338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:10.226783 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:10.227550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:10.228015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:10.228444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:10.440966 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:10.449454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9a8aa741-bf2e-49a5-8dab-3f9860b8db5f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.237908 Aug 06 20:48:10.450303 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 485/973] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:10 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:10.620671 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-5e851099-b126-48ab-94aa-1ba6045b2022 req-2d8d8fe3-9405-4515-b377-1c96c636e8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987aea1f-ee85-44e6-9866-4bda8d485d98", "tag": "b16a2187-4098-4092-9f57-c610ddfecc62"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:10.631390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5e851099-b126-48ab-94aa-1ba6045b2022 req-2d8d8fe3-9405-4515-b377-1c96c636e8dc service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:10.632174 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5e851099-b126-48ab-94aa-1ba6045b2022 req-2d8d8fe3-9405-4515-b377-1c96c636e8dc service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:10.632844 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5e851099-b126-48ab-94aa-1ba6045b2022 req-2d8d8fe3-9405-4515-b377-1c96c636e8dc service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:10.646314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-5e851099-b126-48ab-94aa-1ba6045b2022 req-2d8d8fe3-9405-4515-b377-1c96c636e8dc service nova] Creating event network-changed:b16a2187-4098-4092-9f57-c610ddfecc62 for instance 987aea1f-ee85-44e6-9866-4bda8d485d98 on hv-cinder-85199 Aug 06 20:48:10.652611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-5e851099-b126-48ab-94aa-1ba6045b2022 req-2d8d8fe3-9405-4515-b377-1c96c636e8dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035891 Aug 06 20:48:10.654264 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 489/974] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:48:11.470664 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:11.471209 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:11.477277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:11.477759 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:11.478195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:11.478883 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:11.479940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:11.480369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:11.610857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:11.618310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-23ca4710-31f4-4119-9c49-a3f69de85ea1 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.151578 Aug 06 20:48:11.618873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 486/975] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:11 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:12.639110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:12.639971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:12.646169 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:12.646654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:12.647094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:12.647810 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:12.648273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:12.648699 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:12.780122 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:12.787629 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2e8908de-e2fc-44dd-8903-df37fea2e9c2 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.153157 Aug 06 20:48:12.788195 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 490/976] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:12 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:13.809904 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:13.810678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:13.817791 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:13.818416 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:13.818927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:13.819654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:13.820224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:13.820779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:13.953094 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:13.960602 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b73ce375-7b81-482e-a4d5-3a631f26e99e tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.155312 Aug 06 20:48:13.961413 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 487/977] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:13 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:48:14.981827 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:14.982439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:14.989806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:14.989806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:14.989806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:14.990463 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:14.990913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:14.991437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:15.125295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:15.135391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-15a23d19-b6a3-478e-ad9d-9a9edb61ddbb tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.157728 Aug 06 20:48:15.136088 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 491/978] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:14 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:16.157212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:16.157894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:16.164534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:16.165022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:16.165452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:16.166328 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:16.167460 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:16.167910 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:16.206876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-ca1df093-06bd-4910-a50d-01a6764cbce3 req-e9f32b78-aeee-4d39-99ad-ab0ff4013363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987aea1f-ee85-44e6-9866-4bda8d485d98", "name": "network-vif-plugged", "status": "completed", "tag": "b16a2187-4098-4092-9f57-c610ddfecc62"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:16.218317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-ca1df093-06bd-4910-a50d-01a6764cbce3 req-e9f32b78-aeee-4d39-99ad-ab0ff4013363 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:16.219083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-ca1df093-06bd-4910-a50d-01a6764cbce3 req-e9f32b78-aeee-4d39-99ad-ab0ff4013363 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:16.219428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-ca1df093-06bd-4910-a50d-01a6764cbce3 req-e9f32b78-aeee-4d39-99ad-ab0ff4013363 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:16.231828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-ca1df093-06bd-4910-a50d-01a6764cbce3 req-e9f32b78-aeee-4d39-99ad-ab0ff4013363 service nova] Creating event network-vif-plugged:b16a2187-4098-4092-9f57-c610ddfecc62 for instance 987aea1f-ee85-44e6-9866-4bda8d485d98 on hv-cinder-85199 Aug 06 20:48:16.237428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-ca1df093-06bd-4910-a50d-01a6764cbce3 req-e9f32b78-aeee-4d39-99ad-ab0ff4013363 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033972 Aug 06 20:48:16.242127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 492/979] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:48:16.314042 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:16.321544 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-478bfcea-1b22-4858-9a26-ac2e9b1a3f3d tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.168515 Aug 06 20:48:16.322112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 488/980] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:16 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:17.343932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:17.344632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:17.350726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:17.351211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:17.351679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:17.352374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:17.352835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:17.353292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:17.487755 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:17.495822 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-21460b19-1b18-4922-960c-56d814de8f0f tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1313 microversion: 2.1 time: 0.156646 Aug 06 20:48:17.496379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 493/981] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:17 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:18.516921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:18.517528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:18.519974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:18.525420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:18.525917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:18.526356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:18.527706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:18.528166 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:18.528594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:18.656639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:18.663933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-666cd0e7-3c3c-493b-b1a4-a1fc61bbb3ae tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1496 microversion: 2.1 time: 0.150897 Aug 06 20:48:18.664523 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 489/982] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:18 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:19.400441 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:19.400961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:19.402915 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:19.403599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:19.411772 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:19.412417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:19.413121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:19.413836 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:19.414326 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:19.414761 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:19.441921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Going to try to terminate instance {{(pid=129475) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:48:19.522069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-29283c4d-a8e9-41df-a872-075f5ef64d3b tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "DELETE /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 204 len: 0 microversion: 2.1 time: 0.125057 Aug 06 20:48:19.522658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 494/983] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:48:19 2022] DELETE /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:48:19.531366 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:19.531985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:19.538358 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:19.538847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:19.539324 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:19.540025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:19.540486 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:19.540913 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:19.672206 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:19.679657 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6b07aaeb-f960-4c84-bc12-7488ba9249a6 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1502 microversion: 2.1 time: 0.152182 Aug 06 20:48:19.680246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 490/984] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:19 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:20.701181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:20.701884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:20.708493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:20.708974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:20.709433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:20.710120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:20.710576 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:20.711001 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:20.837764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:20.845292 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c687b4c9-06bb-41b6-9247-5cc660d251b5 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1502 microversion: 2.1 time: 0.149037 Aug 06 20:48:20.845799 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 495/985] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:20 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:21.677256 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-52609af8-a9d1-43d4-8c42-371d46b065ef req-3ff41bd1-f8aa-4cd4-a0dd-dd65fafc8a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987aea1f-ee85-44e6-9866-4bda8d485d98", "name": "network-vif-deleted", "tag": "b16a2187-4098-4092-9f57-c610ddfecc62"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:48:21.682994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:21.692259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-52609af8-a9d1-43d4-8c42-371d46b065ef req-3ff41bd1-f8aa-4cd4-a0dd-dd65fafc8a66 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:21.692738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-52609af8-a9d1-43d4-8c42-371d46b065ef req-3ff41bd1-f8aa-4cd4-a0dd-dd65fafc8a66 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:21.693167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-52609af8-a9d1-43d4-8c42-371d46b065ef req-3ff41bd1-f8aa-4cd4-a0dd-dd65fafc8a66 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:21.705987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-52609af8-a9d1-43d4-8c42-371d46b065ef req-3ff41bd1-f8aa-4cd4-a0dd-dd65fafc8a66 service nova] Creating event network-vif-deleted:b16a2187-4098-4092-9f57-c610ddfecc62 for instance 987aea1f-ee85-44e6-9866-4bda8d485d98 on hv-cinder-85199 Aug 06 20:48:21.711518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-52609af8-a9d1-43d4-8c42-371d46b065ef req-3ff41bd1-f8aa-4cd4-a0dd-dd65fafc8a66 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038251 Aug 06 20:48:21.712132 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 491/986] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:48:21.866190 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:21.866798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:21.873884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:21.874368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:21.874805 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:21.875543 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:21.876003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:21.876433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:21.909477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:21.909956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:21.910385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:21.910826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lazy-loading 'fault' on Instance uuid 987aea1f-ee85-44e6-9866-4bda8d485d98 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:48:21.952429 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b066fface374ff0bc373f7a06a7233a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3959e559ae642e88844b20c26cc39d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:48:21.959729 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a2426ec7-993b-4aaf-b37a-7d9af7fbd6c0 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 200 len: 1303 microversion: 2.1 time: 0.097661 Aug 06 20:48:21.960291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 496/987] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:21 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:48:22.981933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:48:22.982744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] [instance: 987aea1f-ee85-44e6-9866-4bda8d485d98] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:48:22.989604 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:22.990181 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:22.990623 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:22.994409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:48:22.994409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:48:22.994409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:48:23.005812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] HTTP exception thrown: Instance 987aea1f-ee85-44e6-9866-4bda8d485d98 could not be found. Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Request method failure captured: Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 HTTP/1.1 Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tN0O3H1aeembJbAWA0VzsiBUqne1ORAq7mSzHYUu7adcb9FY0wibzlH6K0673HKxryPMKk5NpH__DZUaYg-M5gGQ51hiu1U1s1kuwza6Vc2_SRHbQFz1L99cmz1iVmF4KVwa7GyPTSNYT0uXbR0EqkeZTrLgjm3LdqiBSRMyoqF9rE Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: e3959e559ae642e88844b20c26cc39d5 Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesActionsTest-659813618 Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:48:23.007476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e3959e559ae642e88844b20c26cc39d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesActionsTest-659813618 Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: e3959e559ae642e88844b20c26cc39d5 Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesActionsTest-659813618 Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesActionsTest-659813618-project Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 2b066fface374ff0bc373f7a06a7233a Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesActionsTest-659813618-project Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 987aea1f-ee85-44e6-9866-4bda8d485d98 could not be found. Aug 06 20:48:23.009005 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '987aea1f-ee85-44e6-9866-4bda8d485d98'} Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987aea1f-ee85-44e6-9866-4bda8d485d98 could not be found. Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:48:23.009807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987aea1f-ee85-44e6-9866-4bda8d485d98 could not be found. Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987aea1f-ee85-44e6-9866-4bda8d485d98 could not be found. Aug 06 20:48:23.011649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:48:23.012761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] Returning 404 to user: Instance 987aea1f-ee85-44e6-9866-4bda8d485d98 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:48:23.012761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a73cd3d5-e267-451e-8342-eaa9fd0115f9 tempest-VolumesActionsTest-659813618 tempest-VolumesActionsTest-659813618-project] 10.222.0.17 "GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98" status: 404 len: 111 microversion: 2.1 time: 0.031705 Aug 06 20:48:23.012761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 492/988] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:48:22 2022] GET /compute/v2.1/servers/987aea1f-ee85-44e6-9866-4bda8d485d98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:01.108797 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:01.110932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:01.113150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:01.113792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:01.119618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:01.120100 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:01.120532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:01.121216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:01.121665 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:01.122086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:01.151269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1752bdd7-300e-475e-940c-387428c566fa tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047324 Aug 06 20:49:01.151814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 497/989] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 20:49:01 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:01.210739 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:01.211524 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:01.214782 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:01.215439 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:01.220820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:01.221306 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:01.221741 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:01.222436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:01.222891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:01.223343 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:01.248897 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:49:01.325347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-79d4f309-dd21-4542-aea7-13b52215f6e6 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 204 len: 0 microversion: 2.20 time: 0.117826 Aug 06 20:49:01.327076 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 493/990] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 20:49:01 2022] DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:49:01.335526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:01.335866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:01.342575 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:01.343055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:01.343517 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:01.344203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:01.344653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:01.345069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:01.479885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:01.487589 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:01.489108 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:01.490270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eb6101e6-a259-4e58-bab7-ea2fabb0b7d0 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.158969 Aug 06 20:49:01.490828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 498/991] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:49:01 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:49:02.326935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:49:02.327632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:49:02.513412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:02.513994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:02.520139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:02.520629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:02.521066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:02.521760 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:02.522218 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:02.522645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:02.653554 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:02.662167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:02.663700 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:02.664871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-780b74f5-4ff0-4c63-bcfe-594121854de2 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.155867 Aug 06 20:49:02.665426 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 494/992] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:49:02 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:49:03.692338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:03.692338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:03.696866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:03.697351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:03.697781 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:03.698480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:03.699181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:03.699973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:03.906974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:03.917827 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:03.920590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8dcb94f981244d569f1dd791a4d911ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a301a9f453aa435dbd07ff1d074e5a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:03.922385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-69f43023-6b16-4271-93af-0e5fcaf594c7 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 200 len: 1722 microversion: 2.20 time: 0.237485 Aug 06 20:49:03.922911 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 499/993] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:49:03 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 20:49:04.446478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-004f9259-68a4-4d70-95ff-28179ce404d9 req-d8572571-3677-4511-ab28-cfb681f3c6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3ecda1-4a6d-4688-82b3-a20816a260c0", "name": "network-vif-deleted", "tag": "6fd7b112-713c-4645-9ef1-dadf3f856ec4"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:04.459586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-004f9259-68a4-4d70-95ff-28179ce404d9 req-d8572571-3677-4511-ab28-cfb681f3c6bc service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:04.460656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-004f9259-68a4-4d70-95ff-28179ce404d9 req-d8572571-3677-4511-ab28-cfb681f3c6bc service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:04.461871 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-004f9259-68a4-4d70-95ff-28179ce404d9 req-d8572571-3677-4511-ab28-cfb681f3c6bc service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:04.474574 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-004f9259-68a4-4d70-95ff-28179ce404d9 req-d8572571-3677-4511-ab28-cfb681f3c6bc service nova] Creating event network-vif-deleted:6fd7b112-713c-4645-9ef1-dadf3f856ec4 for instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 on hv-cinder-85199 Aug 06 20:49:04.479930 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-004f9259-68a4-4d70-95ff-28179ce404d9 req-d8572571-3677-4511-ab28-cfb681f3c6bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186189 Aug 06 20:49:04.484633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 495/994] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:04.945643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:04.946246 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:04.953339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:04.953797 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:04.954227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:04.959572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:04.960047 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:04.960481 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:04.975420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] HTTP exception thrown: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Request method failure captured: Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 HTTP/1.1 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tGDfes_xtQozvih3HwnFDYatcnCP10nBx9YeMcVBrTo7jCmtOK0Qz9i4N0Ie25S28L0UOjCMhl4GfXJqPYGhXwn1jTwp6S42c4nGozKMXFcVvGLTV_4L3UsUYJtjyqjcOcGNPOP1B7Q7xyFwiBBvbybBJ8tMlrkQFAQiS4gKtutEXw Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:49:04.977084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 8dcb94f981244d569f1dd791a4d911ac Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:04.978829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': 'ea3ecda1-4a6d-4688-82b3-a20816a260c0'} Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:04.979854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:04.981288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:04.982631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Returning 404 to user: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:04.982631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-95c72f2f-5477-4c2b-9dd3-fb384391b89d tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 404 len: 111 microversion: 2.20 time: 0.036813 Aug 06 20:49:04.982631 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 500/995] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:49:04 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:49:04.989300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-848d5fb2-dffe-4c2f-9a6c-c04b0b33f78b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '.version_select at 0x7fba95dfd4c0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:05.010504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-848d5fb2-dffe-4c2f-9a6c-c04b0b33f78b tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628378290" status: 204 len: 0 microversion: 2.20 time: 0.025607 Aug 06 20:49:05.011437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 496/996] 10.222.0.17 () {60 vars in 1259 bytes} [Sat Aug 6 20:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628378290 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 20:49:06.273502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1142389767", "imageRef": "bbaca720-88c3-4a12-9553-3dd4bfa2c162", "flavorRef": "452"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:06.325150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] validate_networks() for None {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:49:06.598889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:49:06.599338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:49:06.599811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:49:06.600216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:49:06.600624 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:49:06.609442 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:06.609920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:06.610345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:06.611061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:06.611548 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:06.611980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:06.628432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Getting quotas for project c784bdc989fc4985a5a72715fd8c1709. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:49:06.632312 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Getting quotas for user 7304de0bf74e42bca44e9ab7d082fe22 and project c784bdc989fc4985a5a72715fd8c1709. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:49:06.643272 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:49:06.645486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bbaca720-88c3-4a12-9553-3dd4bfa2c162',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:49:06.688439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e8284897-8e96-48aa-b92e-95e109df606a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.418822 Aug 06 20:49:06.689078 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 501/997] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:49:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:49:06.700160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-379d8771-e403-4514-bef5-01092e90dfbd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:06.701558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-379d8771-e403-4514-bef5-01092e90dfbd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:06.755976 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-379d8771-e403-4514-bef5-01092e90dfbd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:06.764203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-379d8771-e403-4514-bef5-01092e90dfbd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1215 microversion: 2.1 time: 0.068356 Aug 06 20:49:06.765422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 497/998] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:06 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:06.776908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:06.777645 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:06.785184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:06.785686 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:06.786124 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:06.786826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:06.787684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:06.788144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:06.801857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] HTTP exception thrown: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Request method failure captured: Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 HTTP/1.1 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tGDfes_xtQozvih3HwnFDYatcnCP10nBx9YeMcVBrTo7jCmtOK0Qz9i4N0Ie25S28L0UOjCMhl4GfXJqPYGhXwn1jTwp6S42c4nGozKMXFcVvGLTV_4L3UsUYJtjyqjcOcGNPOP1B7Q7xyFwiBBvbybBJ8tMlrkQFAQiS4gKtutEXw Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:49:06.804760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 8dcb94f981244d569f1dd791a4d911ac Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.806459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': 'ea3ecda1-4a6d-4688-82b3-a20816a260c0'} Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:06.807393 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.808947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.810778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Returning 404 to user: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:06.810778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f1e08fd5-b882-49df-8545-429739e08aea tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 404 len: 111 microversion: 2.20 time: 0.034712 Aug 06 20:49:06.813727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 502/999] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 20:49:06 2022] DELETE /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:49:06.819396 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:06.820168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: ea3ecda1-4a6d-4688-82b3-a20816a260c0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:06.827560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:06.828465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:06.828972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:06.829743 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:06.830204 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:06.830626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:06.845316 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] HTTP exception thrown: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Request method failure captured: Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 HTTP/1.1 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tGDfes_xtQozvih3HwnFDYatcnCP10nBx9YeMcVBrTo7jCmtOK0Qz9i4N0Ie25S28L0UOjCMhl4GfXJqPYGhXwn1jTwp6S42c4nGozKMXFcVvGLTV_4L3UsUYJtjyqjcOcGNPOP1B7Q7xyFwiBBvbybBJ8tMlrkQFAQiS4gKtutEXw Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:49:06.847462 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 8dcb94f981244d569f1dd791a4d911ac Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.848965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': 'ea3ecda1-4a6d-4688-82b3-a20816a260c0'} Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:06.849726 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. Aug 06 20:49:06.851061 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:06.853744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Returning 404 to user: Instance ea3ecda1-4a6d-4688-82b3-a20816a260c0 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:06.853744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5ba0d6fb-1591-4005-81d6-a363dd5ad3b8 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0" status: 404 len: 111 microversion: 2.20 time: 0.034269 Aug 06 20:49:06.853744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 498/1000] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:49:06 2022] GET /compute/v2.1/servers/ea3ecda1-4a6d-4688-82b3-a20816a260c0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 20:49:07.790690 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:07.792932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:07.801639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:07.802401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:07.802999 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:07.803886 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:07.804493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:07.805067 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:07.889576 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:07.897583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9727ad17-6402-425d-b766-9ff69f464480 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1285 microversion: 2.1 time: 0.114594 Aug 06 20:49:07.907524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 503/1001] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:07 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:07.991091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:07.991691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:07.998159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:07.998648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:07.999084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:07.999810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:08.000266 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:08.000690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:08.014258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] HTTP exception thrown: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Request method failure captured: Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 HTTP/1.1 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tGDfes_xtQozvih3HwnFDYatcnCP10nBx9YeMcVBrTo7jCmtOK0Qz9i4N0Ie25S28L0UOjCMhl4GfXJqPYGhXwn1jTwp6S42c4nGozKMXFcVvGLTV_4L3UsUYJtjyqjcOcGNPOP1B7Q7xyFwiBBvbybBJ8tMlrkQFAQiS4gKtutEXw Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:49:08.015808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 8dcb94f981244d569f1dd791a4d911ac Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.017495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4'} Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:08.018415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.019981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.021502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Returning 404 to user: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:08.021502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9b904275-114a-4550-b9d2-2c74a88b2cf4 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 404 len: 111 microversion: 2.20 time: 0.029927 Aug 06 20:49:08.021502 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 499/1002] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 20:49:07 2022] DELETE /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 20:49:08.025580 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:08.026187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] [instance: 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:08.032723 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:08.033203 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:08.033634 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:08.034321 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:08.034774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:08.035198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:08.048216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] HTTP exception thrown: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Request method failure captured: Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 HTTP/1.1 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tGDfes_xtQozvih3HwnFDYatcnCP10nBx9YeMcVBrTo7jCmtOK0Qz9i4N0Ie25S28L0UOjCMhl4GfXJqPYGhXwn1jTwp6S42c4nGozKMXFcVvGLTV_4L3UsUYJtjyqjcOcGNPOP1B7Q7xyFwiBBvbybBJ8tMlrkQFAQiS4gKtutEXw Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:49:08.049725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a301a9f453aa435dbd07ff1d074e5a08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: a301a9f453aa435dbd07ff1d074e5a08 Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1583172015 Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 8dcb94f981244d569f1dd791a4d911ac Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1583172015-project Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.051379 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4'} Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:08.055409 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. Aug 06 20:49:08.057314 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:08.058783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] Returning 404 to user: Instance 180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:08.058783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-966c7eef-2bcf-4c4a-9203-5cc3b44cee43 tempest-AttachVolumeShelveTestJSON-1583172015 tempest-AttachVolumeShelveTestJSON-1583172015-project] 10.222.0.17 "GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4" status: 404 len: 111 microversion: 2.20 time: 0.029406 Aug 06 20:49:08.058783 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 504/1003] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 20:49:08 2022] GET /compute/v2.1/servers/180c9726-2cfa-4c9f-9ec6-b43d57bfa2e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 06 20:49:08.918331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:08.919554 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:08.926118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:08.926605 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:08.927038 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:08.927804 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:08.928214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:08.928636 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:09.057179 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:09.064621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-40d5bd96-bf14-4bba-87e6-0f92805bca3c tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.150516 Aug 06 20:49:09.065187 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 500/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:08 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:10.085750 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:10.086569 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:10.093059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:10.096795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:10.096795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:10.096795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:10.096795 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:10.097462 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:10.236085 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:10.244390 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a00e26af-bd5d-41c6-98db-a295e3477aec tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.162876 Aug 06 20:49:10.245180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 505/1005] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:10 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:10.852822 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-60fc9261-d7e6-4a8a-95ea-7e7bdc706696 req-90b01aa7-0f91-41df-a75d-50645066dfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b7dd5a-8feb-499b-8be9-c66df50451c7", "tag": "e99842c0-e3d6-4c2a-be16-b0998df5237b"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:10.868647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-60fc9261-d7e6-4a8a-95ea-7e7bdc706696 req-90b01aa7-0f91-41df-a75d-50645066dfa2 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:10.869280 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-60fc9261-d7e6-4a8a-95ea-7e7bdc706696 req-90b01aa7-0f91-41df-a75d-50645066dfa2 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:10.869959 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-60fc9261-d7e6-4a8a-95ea-7e7bdc706696 req-90b01aa7-0f91-41df-a75d-50645066dfa2 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:10.908463 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-60fc9261-d7e6-4a8a-95ea-7e7bdc706696 req-90b01aa7-0f91-41df-a75d-50645066dfa2 service nova] Creating event network-changed:e99842c0-e3d6-4c2a-be16-b0998df5237b for instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 on hv-cinder-85199 Aug 06 20:49:10.913859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-60fc9261-d7e6-4a8a-95ea-7e7bdc706696 req-90b01aa7-0f91-41df-a75d-50645066dfa2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065431 Aug 06 20:49:10.914604 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 501/1006] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:11.267197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:11.269014 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:11.280126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:11.280635 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:11.281079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:11.281804 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:11.282267 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:11.282697 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:11.450566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:11.458487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-733d855b-b7cb-478d-87b6-b9ddc04f4e5a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.196141 Aug 06 20:49:11.459111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 506/1007] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:11 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:12.480191 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:12.480855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:12.487491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:12.487994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:12.488431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:12.489144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:12.489602 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:12.490061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:12.559020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bbc56464-9c21-4abe-a665-a81c52bbe726 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Action: 'create', calling method: .version_select at 0x7fba95f52310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1562136010"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:12.865167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bbc56464-9c21-4abe-a665-a81c52bbe726 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.431094 Aug 06 20:49:12.866062 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 502/1008] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Aug 6 20:49:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 433 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 06 20:49:12.868159 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:12.878273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f35d57db-7dbb-4d58-a57e-e74815640a67 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95dde1f0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:12.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6a7f9324-2188-463c-84be-2a2d2a1523cd tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.403429 Aug 06 20:49:12.880475 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 507/1009] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:12 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:12.928327 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f35d57db-7dbb-4d58-a57e-e74815640a67 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 200 len: 345 microversion: 2.1 time: 0.053705 Aug 06 20:49:12.928889 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 503/1010] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:49:12 2022] GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:49:13.900392 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:13.900927 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:13.907883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:13.908367 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:13.908801 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:13.909489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:13.909945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:13.910370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:13.943908 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b91bfbc4-e09c-4307-b93b-33455f0bd99f tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95f341f0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:13.990887 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b91bfbc4-e09c-4307-b93b-33455f0bd99f tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 200 len: 345 microversion: 2.1 time: 0.051628 Aug 06 20:49:13.991485 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 504/1011] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:49:13 2022] GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:49:14.039720 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:14.047161 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-42c576d7-cb55-4731-9244-05103db426c0 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.150720 Aug 06 20:49:14.047817 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 508/1012] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:13 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:15.005308 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6f9c1f3e-772e-41d4-a2d2-c17a8893e68c tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95e06670>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:15.051291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6f9c1f3e-772e-41d4-a2d2-c17a8893e68c tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 200 len: 346 microversion: 2.1 time: 0.050182 Aug 06 20:49:15.051876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 505/1013] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:49:14 2022] GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:15.063769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6a8d10d8-79db-4611-8fe6-86e4e1837fab tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Action: 'create', calling method: .version_select at 0x7fba9582fca0>, body: {"snapshot": {"volume_id": "344521f5-c83f-47da-a0a0-f3cf9e8e116e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-498728267"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:15.066941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:15.067705 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:15.073951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:15.074444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:15.074888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:15.075621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:15.076084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:15.076518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:15.217598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:15.225041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b9fff439-5981-4fea-b6a1-864229df3f85 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.161635 Aug 06 20:49:15.225597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 506/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:15 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:49:15.230267 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6a8d10d8-79db-4611-8fe6-86e4e1837fab tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.170192 Aug 06 20:49:15.230950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 509/1015] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Aug 6 20:49:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:49:15.242436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-84044165-1a04-4fa8-a611-ffde44ec9e6c tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95f34280>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:15.272197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-84044165-1a04-4fa8-a611-ffde44ec9e6c tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.033512 Aug 06 20:49:15.272813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 507/1016] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:15 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:15.284104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8de83aee-0a02-4ecd-bdfb-7ed937bb1d85 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba958e9700>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:15.314918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8de83aee-0a02-4ecd-bdfb-7ed937bb1d85 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034571 Aug 06 20:49:15.315516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 510/1017] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Aug 6 20:49:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:15.325882 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2a3593f6-33a5-466c-be5b-dc59ef59e461 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95dde670>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:15.354708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2a3593f6-33a5-466c-be5b-dc59ef59e461 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.032501 Aug 06 20:49:15.355263 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 508/1018] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:15 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:16.248407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:16.249020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:16.254947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:16.255464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:16.256325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:16.257581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:16.258038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:16.258460 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:16.368154 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-181c8939-f536-43f6-8c63-1cb35e187c5d tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95dfd310>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:16.383585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:16.391589 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fbdc5317-6fa1-44fd-948c-9a6290101c14 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.147460 Aug 06 20:49:16.392154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 511/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:16 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:16.398639 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-181c8939-f536-43f6-8c63-1cb35e187c5d tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.034719 Aug 06 20:49:16.399527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 509/1020] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:16 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:49:17.409337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:17.411724 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-75959fbd-4432-42c4-8de0-eb6eca53a98b tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba958758b0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:17.414637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:17.415259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:17.418384 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:17.420069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=6 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:17.422536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:17.423034 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:17.423504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:17.424238 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:17.424693 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:17.425120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:17.445457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-75959fbd-4432-42c4-8de0-eb6eca53a98b tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.037937 Aug 06 20:49:17.446027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 512/1021] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:17 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:17.553675 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:17.561000 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b1e6f134-2420-43b2-af0d-7c2ea8558726 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.152574 Aug 06 20:49:17.561592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 510/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:17 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:49:18.458581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-87fc60f9-2d73-4c1f-8eee-35b31f02d7f1 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba958b5a60>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:18.487785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-87fc60f9-2d73-4c1f-8eee-35b31f02d7f1 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.033570 Aug 06 20:49:18.488361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 513/1023] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:18 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:18.581241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:18.582495 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:18.589156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:18.589646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:18.590087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:18.590786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:18.591329 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:18.591690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:18.723645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:18.731532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0209a1c3-83a7-420c-8e8d-6ef3fa421513 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.154037 Aug 06 20:49:18.732138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 511/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:18 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:19.501791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0945989e-46a2-4b5e-a251-4acae06e1f00 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba958e2ca0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:19.530322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0945989e-46a2-4b5e-a251-4acae06e1f00 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.034041 Aug 06 20:49:19.530879 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 514/1025] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:19 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:19.752866 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:19.753445 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:19.759848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:19.760339 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:19.760775 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:19.761465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:19.761923 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:19.762351 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:19.886691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:19.894530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f40115a2-e3c4-4087-a251-05e69686c9f5 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.145605 Aug 06 20:49:19.895093 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 512/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:19 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:20.546253 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3caa00c1-f620-41d6-99ff-5ab086e2fd6a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95870d30>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:20.578944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3caa00c1-f620-41d6-99ff-5ab086e2fd6a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.039999 Aug 06 20:49:20.581072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 515/1027] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:20 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:20.915795 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:20.916750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:20.926093 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:20.926604 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:20.927050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:20.927905 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:20.928371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:20.929533 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:21.077570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:21.086660 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c43ed2cd-15eb-4478-9c24-f8aca1101545 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.174851 Aug 06 20:49:21.087335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 513/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:20 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:21.593154 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6bf2c6f7-2522-4551-851e-2fd2d36454e2 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba958750d0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:21.622744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6bf2c6f7-2522-4551-851e-2fd2d36454e2 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 287 microversion: 2.1 time: 0.034849 Aug 06 20:49:21.623340 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 516/1029] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:21 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:21.635721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d2b8a61e-228b-4bb0-95e8-e082e86c51dc tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95f52310>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:21.700492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d2b8a61e-228b-4bb0-95e8-e082e86c51dc tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 202 len: 0 microversion: 2.1 time: 0.069514 Aug 06 20:49:21.705328 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 514/1030] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Aug 6 20:49:21 2022] DELETE /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:49:21.710370 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-55664bc5-0ff5-4b4c-812d-8eb1ab59cb63 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba9a7f3d30>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:21.761694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-55664bc5-0ff5-4b4c-812d-8eb1ab59cb63 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 200 len: 286 microversion: 2.1 time: 0.055005 Aug 06 20:49:21.762297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 517/1031] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:21 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:22.116408 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:22.117082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:22.122894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:22.123420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:22.123855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:22.124539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:22.124989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:22.125412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:22.254496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:22.262591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ab7dd196-b6d7-41bf-9100-d3f19e146048 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.150712 Aug 06 20:49:22.267293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 515/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:22 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:22.750489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-e95c210d-39e9-455a-8d91-010444b44610 req-18db22be-3f69-44df-bf5c-2438d9b2375b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b7dd5a-8feb-499b-8be9-c66df50451c7", "name": "network-vif-plugged", "status": "completed", "tag": "e99842c0-e3d6-4c2a-be16-b0998df5237b"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:22.760593 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e95c210d-39e9-455a-8d91-010444b44610 req-18db22be-3f69-44df-bf5c-2438d9b2375b service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:22.761077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e95c210d-39e9-455a-8d91-010444b44610 req-18db22be-3f69-44df-bf5c-2438d9b2375b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:22.762276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-e95c210d-39e9-455a-8d91-010444b44610 req-18db22be-3f69-44df-bf5c-2438d9b2375b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:22.773862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fcc6d1d0-c488-4ae7-af14-f94b37a7479a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95f349d0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:22.776306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-e95c210d-39e9-455a-8d91-010444b44610 req-18db22be-3f69-44df-bf5c-2438d9b2375b service nova] Creating event network-vif-plugged:e99842c0-e3d6-4c2a-be16-b0998df5237b for instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 on hv-cinder-85199 Aug 06 20:49:22.782733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-e95c210d-39e9-455a-8d91-010444b44610 req-18db22be-3f69-44df-bf5c-2438d9b2375b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Aug 06 20:49:22.783864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 518/1033] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:22.804448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-fcc6d1d0-c488-4ae7-af14-f94b37a7479a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] HTTP exception thrown: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fcc6d1d0-c488-4ae7-af14-f94b37a7479a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Request method failure captured: Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 HTTP/1.1 Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tPISJQB14o3Ax9wDtAdFlbe2vU-RBa0Q4oHsbCh04G4hlth0qV9l5cqKh731S-ozMMiXKjPGctP252YI0DgGiKGjjN1t2iOSmH3F0HdWP7x-Q6Vn9wtoTakX-gZNqDfOn1Bh9NklOGmFWsEDIJzGzhcvntuyzBD92void-IbvAk67A Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:49:22.806870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 79160a56705945c9a96b83d4c979a959 Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '38f3a141-9e46-4436-9d2f-225b5dede9e1'} Aug 06 20:49:22.808570 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. (HTTP 404) (Request-ID: req-0f44e9ea-03d0-4366-8532-048efbc0ea29) Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.809478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:49:22.812259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 06 20:49:22.817345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fcc6d1d0-c488-4ae7-af14-f94b37a7479a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Returning 404 to user: Snapshot 38f3a141-9e46-4436-9d2f-225b5dede9e1 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:22.818833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fcc6d1d0-c488-4ae7-af14-f94b37a7479a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1" status: 404 len: 111 microversion: 2.1 time: 0.038834 Aug 06 20:49:22.819978 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 516/1034] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 20:49:22 2022] GET /compute/v2.1/os-snapshots/38f3a141-9e46-4436-9d2f-225b5dede9e1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:49:22.820960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-8051ebc0-1063-40f1-8fb5-03d9d423da12 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba958b54c0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:22.918139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-8051ebc0-1063-40f1-8fb5-03d9d423da12 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 202 len: 0 microversion: 2.1 time: 0.103176 Aug 06 20:49:22.919151 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 519/1035] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:49:22 2022] DELETE /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:49:22.929078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-cce8b1e3-6856-46f7-86a8-7c4746e42c8b tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95fd1040>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:22.995831 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-cce8b1e3-6856-46f7-86a8-7c4746e42c8b tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 200 len: 345 microversion: 2.1 time: 0.071204 Aug 06 20:49:22.997557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 517/1036] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:49:22 2022] GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:49:23.284713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:23.285359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:23.291753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:23.292238 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:23.292670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:23.293465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:23.293918 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:23.294340 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:23.430025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:23.437615 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7a25a030-1763-42c9-9755-a3c1eeb386f6 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.157049 Aug 06 20:49:23.438204 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 520/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:23 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:24.016253 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6b6ab3ff-7729-4fc5-bf6d-3dcdc4e7f690 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95fd1e50>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:24.047508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-6b6ab3ff-7729-4fc5-bf6d-3dcdc4e7f690 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] HTTP exception thrown: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6b6ab3ff-7729-4fc5-bf6d-3dcdc4e7f690 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Request method failure captured: Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e HTTP/1.1 Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tPISJQB14o3Ax9wDtAdFlbe2vU-RBa0Q4oHsbCh04G4hlth0qV9l5cqKh731S-ozMMiXKjPGctP252YI0DgGiKGjjN1t2iOSmH3F0HdWP7x-Q6Vn9wtoTakX-gZNqDfOn1Bh9NklOGmFWsEDIJzGzhcvntuyzBD92void-IbvAk67A Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:49:24.049435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 79160a56705945c9a96b83d4c979a959 Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '344521f5-c83f-47da-a0a0-f3cf9e8e116e'} Aug 06 20:49:24.051874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. (HTTP 404) (Request-ID: req-bdc203eb-ed49-434a-9ccf-ab6a2d7209f9) Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.052884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:49:24.055323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 20:49:24.057630 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6b6ab3ff-7729-4fc5-bf6d-3dcdc4e7f690 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Returning 404 to user: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6b6ab3ff-7729-4fc5-bf6d-3dcdc4e7f690 tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 404 len: 109 microversion: 2.1 time: 0.043503 Aug 06 20:49:24.059799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 518/1038] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:49:24 2022] GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 20:49:24.066394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7d4d0c1c-c246-4068-b44c-9d0fee7fd25a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95a250d0>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:24.096518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-7d4d0c1c-c246-4068-b44c-9d0fee7fd25a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] HTTP exception thrown: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7d4d0c1c-c246-4068-b44c-9d0fee7fd25a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Request method failure captured: Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: DELETE /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e HTTP/1.1 Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tPISJQB14o3Ax9wDtAdFlbe2vU-RBa0Q4oHsbCh04G4hlth0qV9l5cqKh731S-ozMMiXKjPGctP252YI0DgGiKGjjN1t2iOSmH3F0HdWP7x-Q6Vn9wtoTakX-gZNqDfOn1Bh9NklOGmFWsEDIJzGzhcvntuyzBD92void-IbvAk67A Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:49:24.098605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 79160a56705945c9a96b83d4c979a959 Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '344521f5-c83f-47da-a0a0-f3cf9e8e116e'} Aug 06 20:49:24.100172 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. (HTTP 404) (Request-ID: req-765b7760-e55b-4d38-a74f-a8b5b8fbef80) Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.101099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 20:49:24.102563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 20:49:24.103997 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7d4d0c1c-c246-4068-b44c-9d0fee7fd25a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Returning 404 to user: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:24.105355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7d4d0c1c-c246-4068-b44c-9d0fee7fd25a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 404 len: 109 microversion: 2.1 time: 0.037605 Aug 06 20:49:24.106388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 521/1039] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 20:49:24 2022] DELETE /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:24.110182 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a929e0aa-3be1-42b9-ae1c-958ee9d8171a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Calling method '.version_select at 0x7fba95e16dc0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:24.142839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-a929e0aa-3be1-42b9-ae1c-958ee9d8171a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] HTTP exception thrown: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a929e0aa-3be1-42b9-ae1c-958ee9d8171a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Request method failure captured: Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e HTTP/1.1 Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tPISJQB14o3Ax9wDtAdFlbe2vU-RBa0Q4oHsbCh04G4hlth0qV9l5cqKh731S-ozMMiXKjPGctP252YI0DgGiKGjjN1t2iOSmH3F0HdWP7x-Q6Vn9wtoTakX-gZNqDfOn1Bh9NklOGmFWsEDIJzGzhcvntuyzBD92void-IbvAk67A Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:49:24.145624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/540421f4336f4cf5a754a57703f68a0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 540421f4336f4cf5a754a57703f68a0c Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1062269327 Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 79160a56705945c9a96b83d4c979a959 Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1062269327-project Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '344521f5-c83f-47da-a0a0-f3cf9e8e116e'} Aug 06 20:49:24.147147 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. (HTTP 404) (Request-ID: req-f7063108-2f3e-4230-b722-4f6f10f0f2a5) Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.148113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 20:49:24.149471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 20:49:24.150851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-a929e0aa-3be1-42b9-ae1c-958ee9d8171a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] Returning 404 to user: Volume 344521f5-c83f-47da-a0a0-f3cf9e8e116e could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-a929e0aa-3be1-42b9-ae1c-958ee9d8171a tempest-VolumesSnapshotsTestJSON-1062269327 tempest-VolumesSnapshotsTestJSON-1062269327-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e" status: 404 len: 109 microversion: 2.1 time: 0.041218 Aug 06 20:49:24.152568 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 519/1040] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 20:49:24 2022] GET /compute/v2.1/os-volumes/344521f5-c83f-47da-a0a0-f3cf9e8e116e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:24.460073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:24.460684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:24.467759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:24.468243 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:24.468691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:24.469361 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:24.469811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:24.470231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:24.657193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:24.665244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eb8bca70-d99c-47f1-bf3c-387a54009243 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.208890 Aug 06 20:49:24.665744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 522/1041] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:24 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:25.686740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:25.687403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:25.693352 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:25.693834 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:25.694264 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:25.694953 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:25.695437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:25.695856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:25.834334 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:25.842709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ed306a89-c232-4634-a2bf-12e8df74d144 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1315 microversion: 2.1 time: 0.160727 Aug 06 20:49:25.843353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 520/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:25 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:26.862391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:26.863096 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:26.869478 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:26.870144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:26.870572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:26.871471 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:26.871928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:26.872341 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:27.003952 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:27.011342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0859decd-4615-49fa-988d-6587e7116d11 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1465 microversion: 2.1 time: 0.152860 Aug 06 20:49:27.011902 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 523/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:26 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1465 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:49:27.056359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:27.056805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:27.063020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:27.063536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:27.063970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:27.064666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:27.065116 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:27.065539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:27.093241 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:49:27.178428 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bacd218b-5eff-402d-9938-8daee23d417a tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 204 len: 0 microversion: 2.1 time: 0.125618 Aug 06 20:49:27.178982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 521/1044] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:49:27 2022] DELETE /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:49:27.187262 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:27.187964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:27.193748 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:27.194324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:27.194824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:27.195601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:27.196117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:27.196602 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:27.332129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:27.340266 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f7b5d21a-7841-4f6f-8b91-fdbdb8bc7324 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1471 microversion: 2.1 time: 0.156847 Aug 06 20:49:27.340833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 524/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:27 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:28.361921 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:28.362648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:28.369073 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:28.369555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:28.369992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:28.370681 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:28.371136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:28.371591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:28.503918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:28.507670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:28.512576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2732ddbc-560f-41bc-9365-b936d21f8804 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1471 microversion: 2.1 time: 0.154930 Aug 06 20:49:28.513747 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 522/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:28 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:29.533600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:29.534205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:29.540637 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:29.541115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:29.541546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:29.542231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:29.542689 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:29.543105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:29.738776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:29.746512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6c702030-54e7-4cd0-8fdb-df4fb33fdc9f tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1471 microversion: 2.1 time: 0.216631 Aug 06 20:49:29.747092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 525/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:29 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:30.411612 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-c2fbc602-7e56-454c-8384-aaecf612e545 req-63e95109-da0a-4bea-a28e-cc5a3d88f902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b7dd5a-8feb-499b-8be9-c66df50451c7", "name": "network-vif-deleted", "tag": "e99842c0-e3d6-4c2a-be16-b0998df5237b"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:30.428625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-c2fbc602-7e56-454c-8384-aaecf612e545 req-63e95109-da0a-4bea-a28e-cc5a3d88f902 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:30.429761 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-c2fbc602-7e56-454c-8384-aaecf612e545 req-63e95109-da0a-4bea-a28e-cc5a3d88f902 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:30.430579 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-c2fbc602-7e56-454c-8384-aaecf612e545 req-63e95109-da0a-4bea-a28e-cc5a3d88f902 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:30.445807 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-c2fbc602-7e56-454c-8384-aaecf612e545 req-63e95109-da0a-4bea-a28e-cc5a3d88f902 service nova] Creating event network-vif-deleted:e99842c0-e3d6-4c2a-be16-b0998df5237b for instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 on hv-cinder-85199 Aug 06 20:49:30.450956 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-c2fbc602-7e56-454c-8384-aaecf612e545 req-63e95109-da0a-4bea-a28e-cc5a3d88f902 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043675 Aug 06 20:49:30.452235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 523/1048] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:49:30.767848 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:30.768536 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:30.775103 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:30.775711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:30.776197 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:30.777000 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:30.777558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:30.778076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:30.811651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:30.812162 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:30.813295 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:30.813754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lazy-loading 'fault' on Instance uuid 97b7dd5a-8feb-499b-8be9-c66df50451c7 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:49:30.817119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:30.862044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7304de0bf74e42bca44e9ab7d082fe22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c784bdc989fc4985a5a72715fd8c1709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:30.872136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-60af778f-3bd8-42f9-9b9f-930df83a63d9 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 200 len: 1305 microversion: 2.1 time: 0.108238 Aug 06 20:49:30.872731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 526/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:30 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:31.894546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:31.895162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] [instance: 97b7dd5a-8feb-499b-8be9-c66df50451c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:31.897594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:31.903113 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:31.903643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:31.904105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:31.904810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:31.905273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:31.905703 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:31.921183 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] HTTP exception thrown: Instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 could not be found. Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Request method failure captured: Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 HTTP/1.1 Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tO_NL1waxl81Kn7DSdrcZuUQp_RpbU8XiNDzr8gJCST2MTM4fUfzTyNfcINtAZPrvTWCwphs3HOQxo46Es2Lu9NjKEBhghJknrxr5izFtVEPGoYOJbCsoPD1nZx437Pcei7SAfZbNd3wmkvgshY8D6dVYMQ2sR_2qpt7-hGhuIzroo Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: c784bdc989fc4985a5a72715fd8c1709 Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-VolumesNegativeTest-79622230 Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:49:31.922844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c784bdc989fc4985a5a72715fd8c1709"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c784bdc989fc4985a5a72715fd8c1709"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c784bdc989fc4985a5a72715fd8c1709"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c784bdc989fc4985a5a72715fd8c1709"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-VolumesNegativeTest-79622230 Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: c784bdc989fc4985a5a72715fd8c1709 Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-VolumesNegativeTest-79622230 Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-VolumesNegativeTest-79622230-project Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 7304de0bf74e42bca44e9ab7d082fe22 Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-VolumesNegativeTest-79622230-project Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 could not be found. Aug 06 20:49:31.924527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '97b7dd5a-8feb-499b-8be9-c66df50451c7'} Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 could not be found. Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:49:31.925458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 could not be found. Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 could not be found. Aug 06 20:49:31.926900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:49:31.928200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] Returning 404 to user: Instance 97b7dd5a-8feb-499b-8be9-c66df50451c7 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:49:31.928200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5678a19d-42de-4a4d-91bf-02006f2f0c19 tempest-VolumesNegativeTest-79622230 tempest-VolumesNegativeTest-79622230-project] 10.222.0.17 "GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7" status: 404 len: 111 microversion: 2.1 time: 0.034028 Aug 06 20:49:31.928200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 524/1050] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:31 2022] GET /compute/v2.1/servers/97b7dd5a-8feb-499b-8be9-c66df50451c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:38.507698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:38.508306 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:38.510375 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:38.522440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:38.522949 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:38.523417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:38.525878 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:38.530475 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:38.531433 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:38.561476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lazy-loading 'flavor' on Instance uuid 14b71891-ae29-4234-aa8e-8bd19d79e119 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:49:38.676114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-68b6546f-71e2-43c1-9828-2d195b61e76d tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "POST /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119/action" status: 202 len: 0 microversion: 2.1 time: 0.172805 Aug 06 20:49:38.677720 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 527/1051] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:49:38 2022] POST /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:49:38.686106 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:38.687678 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:38.696813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:38.697962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:38.698765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:38.699968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:38.701518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:38.702127 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:38.985805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:38.993536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3370db02-0fb6-4421-9aad-3daa033c7d57 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.311701 Aug 06 20:49:38.994299 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 525/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:38 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:40.015907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:40.016615 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:40.023881 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:40.024500 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:40.024947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:40.025656 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:40.026225 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:40.026669 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:40.281785 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:40.289524 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1ff4f5ab-872c-42a4-af36-ea8025c5c207 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.279046 Aug 06 20:49:40.303650 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 528/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:40 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:41.315840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:41.316603 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:41.322861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:41.323465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:41.323981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:41.324894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:41.327528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:41.328207 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:41.495525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:41.508109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-75501512-3373-499d-a691-2c3942cc1a82 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.196485 Aug 06 20:49:41.508763 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 526/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:41 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:49:42.532328 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:42.534101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:42.544251 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:42.545086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:42.546191 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:42.547265 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:42.547939 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:42.549255 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:42.765991 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:42.786896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6047ee3e-173c-433c-816e-2273d08dc23e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.260991 Aug 06 20:49:42.798496 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 529/1055] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:42 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:43.820968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:43.821622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:43.836117 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:43.836744 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:43.837427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:43.839292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:43.839870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:43.842082 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:44.211796 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:44.226138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b95de50e-f7f4-42e4-a37b-af74666564f1 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.409413 Aug 06 20:49:44.228164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 527/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:43 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:45.249975 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:45.251167 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:45.268704 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:45.269470 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:45.270092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:45.270982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:45.271643 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:45.272233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:45.716936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:45.741784 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b93e9e63-425c-4dc7-98db-11f9d62e8909 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.496927 Aug 06 20:49:45.742386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 530/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:45 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:46.771278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:46.772663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:46.780847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:46.781909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:46.781909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:46.782520 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:46.782981 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:46.783433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:46.938060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:46.945915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-84cab868-83ae-4125-9c28-6eb529d2b5b0 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.183078 Aug 06 20:49:46.946472 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 528/1058] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:46 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:47.968153 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:47.969461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:47.976560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:47.977164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:47.977754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:47.982241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:47.982927 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:47.983499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:48.157881 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:48.183952 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6b402137-2119-4449-b883-e052f5e97580 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.220216 Aug 06 20:49:48.185679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 531/1059] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:47 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:49.209555 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:49.211165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:49.220382 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:49.221873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:49.222525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:49.223487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:49.224190 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:49.224805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:49.812733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:49.822378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-224254b5-4a81-4505-ad05-20f6f71826f4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.620788 Aug 06 20:49:49.823294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 529/1060] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:49 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:50.845967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:50.846946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:50.853491 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:50.854076 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:50.854755 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:50.855715 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:50.856814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:50.857312 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:51.012042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:51.021249 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-dce17662-246c-47cc-b68e-8627484dfadb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.178557 Aug 06 20:49:51.022618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 532/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:50 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:52.045496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:52.046102 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:52.055559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:52.056282 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:52.056880 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:52.060516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:52.061176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:52.061620 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:52.272547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:52.283595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-07815b44-e3a7-4f7f-a203-5a3ee82cd05b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.242248 Aug 06 20:49:52.285717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 530/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:52 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:53.306703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:53.307438 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:53.314212 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:53.314954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:53.315421 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:53.316119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:53.316745 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:53.317173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:53.492658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:53.506297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e2205611-3b3a-4948-a2a0-d1f2829085e4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1510 microversion: 2.1 time: 0.203897 Aug 06 20:49:53.506882 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 533/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:53 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:53.531153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:53.531841 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:53.539547 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:53.540294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:53.540929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:53.541646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:53.542112 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:53.542545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:53.576434 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=129476) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 20:49:53.654433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-07991c00-0827-4463-bd92-039ab88daf05 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "POST /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119/action" status: 202 len: 0 microversion: 2.1 time: 0.128453 Aug 06 20:49:53.655046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 531/1064] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:49:53 2022] POST /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:49:53.665139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:53.666432 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:53.674226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:53.674737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:53.675188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:53.676147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:53.676619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:53.677053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:53.884648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:53.899501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-1b08b8ae-7e9b-48aa-81fe-10fc4cd3ab32 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1518 microversion: 2.1 time: 0.239745 Aug 06 20:49:53.920199 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 534/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:53 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:54.876050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-6491ac64-2324-4901-924d-3fe5fbe8c1f5 req-2938e17d-d0ad-4f3d-9195-ae0fb726b933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "name": "network-vif-unplugged", "status": "completed", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:54.894170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-6491ac64-2324-4901-924d-3fe5fbe8c1f5 req-2938e17d-d0ad-4f3d-9195-ae0fb726b933 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:54.895891 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-6491ac64-2324-4901-924d-3fe5fbe8c1f5 req-2938e17d-d0ad-4f3d-9195-ae0fb726b933 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:54.897027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-6491ac64-2324-4901-924d-3fe5fbe8c1f5 req-2938e17d-d0ad-4f3d-9195-ae0fb726b933 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:54.919440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.compute.server_external_events [req-6491ac64-2324-4901-924d-3fe5fbe8c1f5 req-2938e17d-d0ad-4f3d-9195-ae0fb726b933 service nova] Unable to find a host for instance 14b71891-ae29-4234-aa8e-8bd19d79e119. Dropping event network-vif-unplugged {{(pid=129476) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 06 20:49:54.920852 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-6491ac64-2324-4901-924d-3fe5fbe8c1f5 req-2938e17d-d0ad-4f3d-9195-ae0fb726b933 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.049236 Aug 06 20:49:54.921884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 532/1066] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 06 20:49:54.922109 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:54.922824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:54.930375 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:54.931127 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:54.931787 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:54.932727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:54.933345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:54.934250 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:55.084173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:55.095603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-cce4a31a-a227-4f81-a415-efff74685213 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1520 microversion: 2.1 time: 0.178591 Aug 06 20:49:55.096733 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 535/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:54 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:49:56.116580 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:56.117263 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:56.125156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:56.125645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:56.126074 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:56.126766 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:56.127215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:56.127740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:56.208044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fe27df44-5c33-4028-9751-eddd242fea0b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Action: 'create', calling method: .version_select at 0x7fba95746e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1321080374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZG9+/1nPH3GQDuMXR5QGduWjWSv/qRmHPbjDfP2ytLvJwKzdDI0inxkQgdw9LMSInylAk1AAHEhVypFrRvTgOnPbW/KMWtdl2lFqCxLx4jw0WoLRLhN8pjQy4JYZvtwA=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:56.224146 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-fe27df44-5c33-4028-9751-eddd242fea0b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Getting quotas for project 018934fef0f0449aa106919333cf9d1e. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:49:56.228654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-fe27df44-5c33-4028-9751-eddd242fea0b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Getting quotas for user fdeed99b63844142981d0e8ce3afc850 and project 018934fef0f0449aa106919333cf9d1e. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:49:56.258812 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fe27df44-5c33-4028-9751-eddd242fea0b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054553 Aug 06 20:49:56.259510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 536/1068] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:49:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:49:56.280764 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:56.289135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b2389b6a-7244-4d53-aa65-6d0946e002c8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1520 microversion: 2.1 time: 0.176881 Aug 06 20:49:56.289838 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 533/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:56 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:56.313860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1001813305", "imageRef": "69a2fa66-2194-4f8c-aacc-fae3215d7cb0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1321080374", "networks": [{"uuid": "af58620c-62f3-4593-ae8e-282400d700dd"}]}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:49:56.370619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] validate_networks() for [('af58620c-62f3-4593-ae8e-282400d700dd', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:49:56.796215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:49:56.796637 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:49:56.797352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:49:56.797768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:49:56.798183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:49:56.807437 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:56.807921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:56.808351 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:56.809071 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:56.809521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:56.809940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:56.826534 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Getting quotas for project 018934fef0f0449aa106919333cf9d1e. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:49:56.830455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Getting quotas for user fdeed99b63844142981d0e8ce3afc850 and project 018934fef0f0449aa106919333cf9d1e. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:49:56.842298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:49:56.844526 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='69a2fa66-2194-4f8c-aacc-fae3215d7cb0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:49:56.890268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-af9ad3eb-2271-4452-bf71-428e85b57a2f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580223 Aug 06 20:49:56.890919 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 537/1070] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:49:56.902487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5b4ed6eb-ffaa-44cb-b57a-3b60f2fa17c3 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:56.903786 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5b4ed6eb-ffaa-44cb-b57a-3b60f2fa17c3 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:56.978690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5b4ed6eb-ffaa-44cb-b57a-3b60f2fa17c3 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:56.992501 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5b4ed6eb-ffaa-44cb-b57a-3b60f2fa17c3 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1259 microversion: 2.1 time: 0.094341 Aug 06 20:49:57.005456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 534/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:56 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1259 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:57.311565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:57.312722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:57.319684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:57.320407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:57.321055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:57.321920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:57.322414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:57.322977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:57.535352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:57.542873 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c4f990da-eff9-459f-9542-89dc3ebe9510 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.236269 Aug 06 20:49:57.543960 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 538/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:57 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:58.014125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:58.014743 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:58.021863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:58.022358 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:58.022800 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:58.023533 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:58.023993 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:58.024422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:58.088578 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:58.096812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3172aaa6-40e6-42ec-af17-812b65e9ebe2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1311 microversion: 2.1 time: 0.087164 Aug 06 20:49:58.097372 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 535/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:58 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:58.564260 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:58.564876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:58.571396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:58.571879 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:58.572322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:58.573276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:58.573798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:58.574228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:58.705828 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:58.713537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-343d9124-3db7-4ec0-97db-0eb768eca751 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.153194 Aug 06 20:49:58.714099 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 539/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:58 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:59.117239 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:59.117896 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:59.124328 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:59.124826 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:59.125273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:59.125976 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:59.126437 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:59.126867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:59.195500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:59.204025 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1efd0083-70d6-4467-925d-0d69eb62df0c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1317 microversion: 2.1 time: 0.090648 Aug 06 20:49:59.204955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 536/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:59 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:49:59.738977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:49:59.740893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:49:59.752949 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:59.754116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:59.754815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:59.755846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:49:59.756675 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:49:59.757711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:49:59.978275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:49:59.989249 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0580db8b-4574-48d9-8f62-bb8cff4e5869 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.256561 Aug 06 20:49:59.989838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 540/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:49:59 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:50:00.226331 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:00.228184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:00.236273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:00.237211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:00.237747 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:00.238733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:00.239319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:00.239850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:00.377313 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:00.385399 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0e2a806f-7ea8-4c54-85b7-2c83caafb04b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.163357 Aug 06 20:50:00.385979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 537/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:00 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:01.009921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:01.010657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:01.017298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:01.018084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:01.018815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:01.019776 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:01.020434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:01.021057 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:01.024403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:01.170475 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:01.178300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-28ed34a2-82c3-49a8-bfc7-26f1b58907dd tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.172204 Aug 06 20:50:01.178864 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 541/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:01 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:01.408142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:01.408793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:01.415598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:01.416091 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:01.416530 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:01.417254 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:01.417733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:01.418129 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:01.422458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:01.570697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:01.579336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6da7b87e-55bf-429b-b286-5ec5c94c1f77 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.176370 Aug 06 20:50:01.590505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 538/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:01 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:02.201368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:02.203123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:02.209620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:02.210100 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:02.210530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:02.211529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:02.211980 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:02.212401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:02.372912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:02.380756 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f87f35b8-4813-4a38-b7cd-840437e2a982 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.183577 Aug 06 20:50:02.381333 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 542/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:02 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:02.602753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:02.603400 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:02.605680 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:02.612083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:02.612754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:02.613139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:02.613851 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:02.614305 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:02.614932 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:02.759728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:02.769833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d787fff9-da30-4c75-9859-a9fa68bc7af1 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.170826 Aug 06 20:50:02.770430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 539/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:02 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:03.402711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:03.404202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:03.411511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:03.411940 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:03.412377 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:03.413081 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:03.413570 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:03.414020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:03.556985 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:03.565094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c07272da-55cf-4fc7-a651-4e3b693906ca tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.167239 Aug 06 20:50:03.565684 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 543/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:03 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:03.791208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:03.791859 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:03.799006 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:03.799532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:03.799968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:03.800661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:03.801111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:03.801531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:03.944926 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:03.954973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ea63776c-0a42-42f0-82fa-a9353606b5a5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.167478 Aug 06 20:50:03.960317 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 540/1083] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:03 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:04.586763 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:04.587397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:04.594179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:04.594657 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:04.595089 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:04.595800 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:04.596254 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:04.596691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:04.738275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:04.748735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-76c10d27-3130-4c23-b644-7c199c9ef6dc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.165970 Aug 06 20:50:04.759198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 544/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:04 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:04.976663 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:04.977263 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:04.984305 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:04.985124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:04.985559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:04.986262 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:04.986715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:04.987138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:05.132059 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:05.142553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-0d1e33ba-7d2b-46de-b594-fa56b4cfbbaf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.169702 Aug 06 20:50:05.155677 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 541/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:04 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:05.770335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:05.771694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:05.778350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:05.778835 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:05.779294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:05.779994 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:05.780451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:05.780883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:05.928137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:05.937087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-84c4ab8d-9e27-4c01-9865-e61aea0bf04c tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.170621 Aug 06 20:50:05.938276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 545/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:05 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:06.165020 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:06.165643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:06.172652 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:06.173289 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:06.173563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:06.174246 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:06.174698 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:06.175120 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:06.315892 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:06.323550 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b0d578cc-07dc-4854-9246-5f892f71d0cb tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.162209 Aug 06 20:50:06.334175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 542/1087] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:06 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:06.958476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:06.959092 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:06.961711 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:06.962495 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=10 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:06.969202 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:06.969728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:06.970229 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:06.970937 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:06.971544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:06.972038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:07.101144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:07.109439 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-2fb57927-7cd8-4a5f-8108-650c6792dcb5 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.154917 Aug 06 20:50:07.110003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 546/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:06 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:07.345810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:07.346419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:07.348254 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:07.354018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:07.354498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:07.354956 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:07.355649 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:07.356103 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:07.356526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:07.481576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:07.489492 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-04147288-4d88-4999-8e18-e1b4c745dc31 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.147569 Aug 06 20:50:07.490050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 543/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:07 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:08.131456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:08.132055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:08.138288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:08.138786 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:08.139749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:08.140445 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:08.140904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:08.141331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:08.276487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:08.284574 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d3533a8f-bf90-4987-a04a-fbb14f0761e9 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.156997 Aug 06 20:50:08.285162 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 547/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:08 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:08.509951 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:08.510683 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:08.517165 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:08.517727 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:08.518176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:08.518873 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:08.519366 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:08.519799 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:08.660788 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:08.669356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-eccef998-fa02-42c9-b931-82c63a9750b7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.162611 Aug 06 20:50:08.679626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 544/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:08 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:50:09.305944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:09.306587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:09.309008 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:09.314457 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:09.314946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:09.315415 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:09.316115 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:09.316574 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:09.316999 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:09.455077 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:09.463352 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-22404abe-440d-407b-8bc5-aca27a753285 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.161010 Aug 06 20:50:09.463963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 548/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:09 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:09.689922 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:09.690598 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:09.696690 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:09.697176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:09.697608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:09.698293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:09.698743 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:09.699160 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:09.833928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:09.841671 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-be04ac17-aed9-4134-9b48-e95d2d035754 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.156147 Aug 06 20:50:09.842824 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 545/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:09 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:10.484923 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:10.485540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:10.491827 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:10.492426 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:10.492862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:10.493551 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:10.494005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:10.494428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:10.630396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:10.638090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a0a9ebca-b662-4416-b396-4ce99325e266 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.156936 Aug 06 20:50:10.638655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 549/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:10 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:10.862919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:10.863658 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:10.870233 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:10.870820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:10.871628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:10.872506 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:10.872965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:10.874200 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:11.132244 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:11.139518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b2a30a62-e72e-4ff0-81ce-675fede4e1d9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.280800 Aug 06 20:50:11.140092 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 546/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:10 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:11.431851 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-28986164-625a-49e3-866e-bcb27733fc4c req-2af2f318-aa0b-41d7-b060-bad52821513b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:11.441312 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-28986164-625a-49e3-866e-bcb27733fc4c req-2af2f318-aa0b-41d7-b060-bad52821513b service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:11.441875 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-28986164-625a-49e3-866e-bcb27733fc4c req-2af2f318-aa0b-41d7-b060-bad52821513b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:11.442311 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-28986164-625a-49e3-866e-bcb27733fc4c req-2af2f318-aa0b-41d7-b060-bad52821513b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:11.452961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-28986164-625a-49e3-866e-bcb27733fc4c req-2af2f318-aa0b-41d7-b060-bad52821513b service nova] Creating event network-changed:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:50:11.457893 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-28986164-625a-49e3-866e-bcb27733fc4c req-2af2f318-aa0b-41d7-b060-bad52821513b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029804 Aug 06 20:50:11.458474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 550/1096] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:50:11.660592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:11.661195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:11.667319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:11.667810 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:11.668247 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:11.668935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:11.669393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:11.669818 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:11.893071 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:11.901430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1a26ff9a-033b-4111-bcd0-36feeddcb934 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.244766 Aug 06 20:50:11.902015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 547/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:11 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:12.161194 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:12.162007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:12.168556 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:12.169274 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:12.169713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:12.170597 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:12.171059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:12.171674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:12.356032 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:12.363948 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-f41c56a1-0f81-489e-b3df-8006466e8bc9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.207373 Aug 06 20:50:12.364518 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 551/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:12 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:50:12.923358 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:12.923965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:12.931017 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:12.931537 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:12.931970 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:12.932691 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:12.933143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:12.933562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:13.064234 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:13.071635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dc62bf8f-7409-42d7-a42f-3138e04e0b69 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.152262 Aug 06 20:50:13.072197 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 548/1099] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:12 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:13.384557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:13.385201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:13.392052 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:13.392538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:13.392972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:13.393663 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:13.394116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:13.394541 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:13.520126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:13.527403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-36b4cdd9-34c1-4c33-bd5b-ed1cbcca91c7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.146620 Aug 06 20:50:13.527989 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 552/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:13 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:14.092660 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:14.093302 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:14.099674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:14.100157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:14.100594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:14.101283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:14.101738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:14.102164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:14.230816 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:14.238861 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6e3b0097-65b3-43e8-a986-c676ad1e7377 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.150073 Aug 06 20:50:14.239531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 549/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:14 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:14.548053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:14.548591 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:14.554869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:14.555381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:14.555820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:14.556509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:14.556963 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:14.557388 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:14.682934 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:14.690466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c99d792f-817f-47b5-af73-a347ac7a4b60 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.146898 Aug 06 20:50:14.691043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 553/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:14 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:15.259809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:15.260420 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:15.268086 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:15.268567 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:15.269001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:15.269682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:15.270131 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:15.270551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:15.397908 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:15.405406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bb29562e-47c3-439a-ba8a-591dc37c3fe6 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.149754 Aug 06 20:50:15.405974 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 550/1103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:15 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:15.711826 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:15.712431 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:15.719179 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:15.719693 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:15.720126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:15.720808 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:15.721259 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:15.721681 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:15.849999 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:15.857428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5f70a482-0951-46c2-b848-7964944e5469 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.149588 Aug 06 20:50:15.858516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 554/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:15 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:16.426001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:16.426626 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:16.433019 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:16.433508 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:16.433950 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:16.434647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:16.435107 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:16.436075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:16.562611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:16.569997 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-93afa1af-ab27-4bf6-bf14-33986bc86ad8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.147866 Aug 06 20:50:16.570569 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 551/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:16 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:16.879175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:16.879910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:16.886267 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:16.886824 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:16.887284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:16.887983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:16.888435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:16.888861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:17.274495 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:17.282398 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0d15e4c2-253b-4e87-8be6-81f6ac769e3e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.407150 Aug 06 20:50:17.282968 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 555/1106] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:16 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:17.593146 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:17.593750 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:17.600230 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:17.600708 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:17.601149 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:17.601927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:17.602451 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:17.602879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:17.731989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:17.740002 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-13188265-d437-46fa-8a7e-1626b9391f3e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.151866 Aug 06 20:50:17.740564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 552/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:17 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:18.303381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:18.304013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:18.310876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:18.311385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:18.311820 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:18.312506 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:18.312961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:18.313385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:18.447648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:18.455083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4cbd8ce5-19cf-4da3-8a18-f1e2be1f462c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.155607 Aug 06 20:50:18.455662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 556/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:18 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:18.761255 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:18.761867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:18.770076 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:18.770557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:18.770992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:18.771709 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:18.772170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:18.772592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:18.899870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:18.907967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-86bbfc04-4481-4ec4-89d9-7bc40d0e6c93 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.150582 Aug 06 20:50:18.908542 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 553/1109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:18 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:19.474825 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:19.475469 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:19.481842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:19.482354 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:19.482792 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:19.483510 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:19.483975 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:19.484401 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:19.608327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:19.615945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-137d6aa3-0cf3-40d0-8a30-bc7bde8b6c5c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.144922 Aug 06 20:50:19.616512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 557/1110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:19 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:19.929391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:19.930009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:19.937083 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:19.937576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:19.938016 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:19.938715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:19.939175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:19.939641 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:20.069753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:20.071985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=100 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:20.078442 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fd16e0e9-b254-45b3-ad27-65cbf40feedb tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.152896 Aug 06 20:50:20.079010 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 554/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:19 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:50:20.551778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-3ba8592a-db70-415d-bfc2-b8073030994c req-673b0e35-3d2e-4e23-b4a1-b9babc509a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "name": "network-vif-plugged", "status": "completed", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:20.562454 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-3ba8592a-db70-415d-bfc2-b8073030994c req-673b0e35-3d2e-4e23-b4a1-b9babc509a7f service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:20.562942 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-3ba8592a-db70-415d-bfc2-b8073030994c req-673b0e35-3d2e-4e23-b4a1-b9babc509a7f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:20.563418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-3ba8592a-db70-415d-bfc2-b8073030994c req-673b0e35-3d2e-4e23-b4a1-b9babc509a7f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:20.574291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-3ba8592a-db70-415d-bfc2-b8073030994c req-673b0e35-3d2e-4e23-b4a1-b9babc509a7f service nova] Creating event network-vif-plugged:6ed5e7a9-6704-4da7-8d53-4918b2a196b9 for instance 14b71891-ae29-4234-aa8e-8bd19d79e119 on hv-cinder-85199 Aug 06 20:50:20.579868 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-3ba8592a-db70-415d-bfc2-b8073030994c req-673b0e35-3d2e-4e23-b4a1-b9babc509a7f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 Aug 06 20:50:20.580620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 558/1112] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:50:20.637060 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:20.637672 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:20.643581 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:20.644068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:20.644503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:20.645326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:20.645777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:20.646198 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:20.776048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:20.783296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c8e9b804-57b9-4503-9ba2-33afe60143f6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.150126 Aug 06 20:50:20.783855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 555/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:20 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:21.100070 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:21.100793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:21.106901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:21.108033 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:21.108469 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:21.109151 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:21.109603 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:21.110026 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:21.113936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=100 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:21.240138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:21.247503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-812ad3f4-6697-4140-b440-622cb2212d03 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.151727 Aug 06 20:50:21.248062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 559/1114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:21 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:21.803809 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:21.804418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:21.811738 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:21.812319 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:21.812665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:21.813433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:21.813902 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:21.814322 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:21.941300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:21.948588 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5b0a43cf-bf81-47e7-90cb-1ed6b4bb6f4f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.148547 Aug 06 20:50:21.949150 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 556/1115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:21 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:22.267765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:22.268280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:22.274586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:22.275074 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:22.275552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:22.276243 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:22.276703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:22.277129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:22.405217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:22.412769 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-eedc99ce-825c-4d14-b6c8-c14370b9791e tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.148935 Aug 06 20:50:22.413338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 560/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:22 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:22.970378 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:22.970979 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:22.977359 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:22.977842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:22.978276 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:22.978999 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:22.979481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:22.979909 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:23.103797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:23.111222 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b9a09ef6-6e9a-4589-8f43-545dd06a2fba tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.145392 Aug 06 20:50:23.111812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 557/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:22 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:23.435583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:23.435583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:23.441162 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:23.441639 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:23.442073 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:23.442758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:23.443209 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:23.443667 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:23.572652 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:23.580633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ae5470af-8afc-4887-a903-6cef66b595fc tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.150537 Aug 06 20:50:23.581192 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 561/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:23 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:24.131526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:24.132122 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:24.138458 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:24.138938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:24.139403 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:24.140087 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:24.140538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:24.140955 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:24.266737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:24.273994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2d6e35db-fcac-40f7-a8f1-e39c6ab73308 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.146375 Aug 06 20:50:24.274553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 558/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:24 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:24.601680 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:24.602762 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:24.608833 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:24.609316 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:24.609747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:24.610428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:24.610877 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:24.611318 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:24.741030 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:24.749218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-ac68b177-b552-462d-9673-83da1e224e73 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.151324 Aug 06 20:50:24.749791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 562/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:24 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:50:25.295448 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:25.295998 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:25.302341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:25.302828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:25.303283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:25.303980 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:25.304433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:25.304854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:25.441185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:25.448594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-310485d0-ad52-4720-9806-e71db6d594f7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.157929 Aug 06 20:50:25.449157 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 559/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:25 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:25.770236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:25.770854 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:25.777480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:25.777990 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:25.778424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:25.779660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:25.780112 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:25.780533 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:25.907611 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:25.914987 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-acd40393-46b9-4728-818e-95325f29f37a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.148811 Aug 06 20:50:25.915579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 563/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:25 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:26.468989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:26.469595 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:26.475927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:26.476405 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:26.476839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:26.477518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:26.477968 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:26.478387 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:26.606139 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:26.614296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6bfe86a9-87a3-412f-a922-b8eed78681cf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.149085 Aug 06 20:50:26.614853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 560/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:26 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:26.936232 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:26.936850 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:26.943226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:26.943738 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:26.944175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:26.944863 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:26.945322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:26.945749 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:27.073565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:27.080989 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-0b575a2f-2b82-4c72-a674-d34eb8f1bbfe tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.149216 Aug 06 20:50:27.081553 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 564/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:26 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:27.635145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:27.635776 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:27.642631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:27.643111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:27.643587 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:27.644287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:27.644811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:27.645232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:27.774393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:27.781832 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d9fcd536-0675-4a02-a379-e4f36822e2e0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.150493 Aug 06 20:50:27.782398 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 561/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:27 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:28.102386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:28.103020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:28.109930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:28.110411 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:28.110842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:28.111558 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:28.112012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:28.112427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:28.243688 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:28.252257 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-44dc68db-7cd2-49d6-aeac-91aefed948ac tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1576 microversion: 2.1 time: 0.153629 Aug 06 20:50:28.253187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 565/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:28 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:28.443341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-27fa213c-5f01-454f-8bef-43026efe6156 req-381eccaa-3d67-4d00-9d65-3a75f0660c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "name": "network-vif-plugged", "status": "completed", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:28.456839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-27fa213c-5f01-454f-8bef-43026efe6156 req-381eccaa-3d67-4d00-9d65-3a75f0660c18 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:28.457321 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-27fa213c-5f01-454f-8bef-43026efe6156 req-381eccaa-3d67-4d00-9d65-3a75f0660c18 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:28.457755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-27fa213c-5f01-454f-8bef-43026efe6156 req-381eccaa-3d67-4d00-9d65-3a75f0660c18 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:28.469505 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-27fa213c-5f01-454f-8bef-43026efe6156 req-381eccaa-3d67-4d00-9d65-3a75f0660c18 service nova] Creating event network-vif-plugged:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:50:28.474536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-27fa213c-5f01-454f-8bef-43026efe6156 req-381eccaa-3d67-4d00-9d65-3a75f0660c18 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035053 Aug 06 20:50:28.475427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 562/1127] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:50:28.801908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:28.802456 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:28.808414 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:28.808901 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:28.809341 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:28.810038 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:28.810498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:28.810925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:28.942116 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:28.949482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-aa07e837-a8ea-4fbe-83a6-9252c579b271 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.151488 Aug 06 20:50:28.950050 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 566/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:28 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:29.275043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:29.275884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:29.282895 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:29.283638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:29.284068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:29.284868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:29.285384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:29.285877 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:29.418452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:29.426928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-834a69d0-59d1-4cbd-9407-6865ff0d1317 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1563 microversion: 2.1 time: 0.156378 Aug 06 20:50:29.427543 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 563/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:29 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:29.970477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:29.971102 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:29.977417 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:29.977922 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:29.978359 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:29.979048 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:29.979529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:29.979956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:30.110383 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:30.117841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e9c9d358-df2c-4cb9-aecf-38e72b897f21 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1359 microversion: 2.1 time: 0.151270 Aug 06 20:50:30.118406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 567/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:29 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:31.138536 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:31.139288 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:31.145571 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.146050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.146481 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.147161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.147638 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.148056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.273670 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:31.281789 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d012e90a-cd4e-4257-b313-20bf4210988b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1548 microversion: 2.1 time: 0.147720 Aug 06 20:50:31.282369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 564/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:31 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:31.301722 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:31.302338 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:31.308802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.309294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.309740 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.310499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.310961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.311427 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.526512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:31.534014 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7baa53a8-0e11-43d0-a79b-173a3888fd45 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1548 microversion: 2.1 time: 0.236187 Aug 06 20:50:31.534596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 568/1132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:31 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1548 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:31.553193 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:31.557860 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:31.558631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Searching by: {'deleted': False, 'project_id': '018934fef0f0449aa106919333cf9d1e'} {{(pid=129476) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 20:50:31.565697 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.566180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.566625 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.568755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.568755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.568755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.659476 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.multi_cell_list [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129476) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 20:50:31.764444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-f42628d4-8c2c-4fad-9da8-654ea2126900 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214890 Aug 06 20:50:31.765041 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 565/1133] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Aug 6 20:50:31 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:50:31.776139 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:31.776744 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:31.783055 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.783571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.784006 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.784692 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:31.785146 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:31.785571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:31.988371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:31.996305 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5b8470ef-b0ac-4704-8c56-c991500e77ca tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1548 microversion: 2.1 time: 0.224102 Aug 06 20:50:31.997062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 569/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:31 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:33.526379 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04120ff1-3c9d-40fe-a6f7-0566e8b87738"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:33.528774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:33.531872 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=54 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:33.537496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:33.537982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:33.538419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:33.539105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:33.539591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:33.540018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:33.798384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fd50784a-bbc9-47f5-a839-c396ab22ff05 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275710 Aug 06 20:50:33.798988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 566/1135] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 20:50:33 2022] POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:50:41.379618 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:41.380229 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:41.382735 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=44 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:41.389806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:41.390288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:41.391529 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:41.392233 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:41.393461 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:41.393898 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:41.519944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:41.527738 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6f944a54-8901-4113-ab1b-1f753210782c tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1594 microversion: 2.1 time: 0.152219 Aug 06 20:50:41.528333 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 570/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:41 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:50:43.206097 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:43.210452 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-9e6ffe17-7730-4662-9dcf-3b47dfb22e98 req-f95bd5d6-83f2-43a8-94cb-c69bb8807d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:43.220863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9e6ffe17-7730-4662-9dcf-3b47dfb22e98 req-f95bd5d6-83f2-43a8-94cb-c69bb8807d2b service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:43.221723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9e6ffe17-7730-4662-9dcf-3b47dfb22e98 req-f95bd5d6-83f2-43a8-94cb-c69bb8807d2b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:43.221862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-9e6ffe17-7730-4662-9dcf-3b47dfb22e98 req-f95bd5d6-83f2-43a8-94cb-c69bb8807d2b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:43.234884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-9e6ffe17-7730-4662-9dcf-3b47dfb22e98 req-f95bd5d6-83f2-43a8-94cb-c69bb8807d2b service nova] Creating event network-changed:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:50:43.240415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-9e6ffe17-7730-4662-9dcf-3b47dfb22e98 req-f95bd5d6-83f2-43a8-94cb-c69bb8807d2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035628 Aug 06 20:50:43.241504 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 567/1137] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:50:44.184270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1922023646"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:44.184813 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:44.191297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:44.191793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:44.192443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:44.193144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:44.193605 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:44.194218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:44.325823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.network.security_group_api [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Adding security group e9857249-50f4-4ced-ae67-a45db42140c2 to port 00296fb9-b65a-446f-89ad-28c6311d1609 Aug 06 20:50:44.631880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4c2c64cb-906f-457a-98f1-fcc9302e0435 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/action" status: 202 len: 0 microversion: 2.1 time: 0.451435 Aug 06 20:50:44.632600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 571/1138] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:50:44 2022] POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:50:44.642345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:50:44.643105 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:50:44.650078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:44.651270 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:44.651819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:44.652535 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:44.652994 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:44.653427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:44.808135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:50:44.816109 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5f1de430-fb82-454d-bfec-7a071af46d6b tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1760 microversion: 2.1 time: 0.179095 Aug 06 20:50:44.816689 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 568/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:50:44 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:50:45.254956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-2cf51765-c78c-48bc-aeb5-42de41f324f3 req-d2f4bc70-3160-4b36-a85c-d4318bdfc0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:50:45.266111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-2cf51765-c78c-48bc-aeb5-42de41f324f3 req-d2f4bc70-3160-4b36-a85c-d4318bdfc0a4 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:50:45.266111 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-2cf51765-c78c-48bc-aeb5-42de41f324f3 req-d2f4bc70-3160-4b36-a85c-d4318bdfc0a4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:50:45.266397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-2cf51765-c78c-48bc-aeb5-42de41f324f3 req-d2f4bc70-3160-4b36-a85c-d4318bdfc0a4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:50:45.277188 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-2cf51765-c78c-48bc-aeb5-42de41f324f3 req-d2f4bc70-3160-4b36-a85c-d4318bdfc0a4 service nova] Creating event network-changed:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:50:45.282087 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-2cf51765-c78c-48bc-aeb5-42de41f324f3 req-d2f4bc70-3160-4b36-a85c-d4318bdfc0a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030712 Aug 06 20:50:45.282681 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 572/1140] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:51:40.112685 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:51:40.114946 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:40.117033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=5 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:40.117682 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:40.124162 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:40.124645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:40.125078 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:40.125773 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:40.126224 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:40.126647 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:40.197982 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-383d51e5-454b-4686-a779-645b71162aa7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/action" status: 202 len: 0 microversion: 2.1 time: 0.089283 Aug 06 20:51:40.198594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 569/1141] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:51:40 2022] POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:51:40.204860 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=5 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:40.206109 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=77 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:40.210943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:40.211672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:40.218594 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:40.219079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:40.219560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:40.220247 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:40.220698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:40.221121 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:40.445561 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:40.453658 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3194ed99-ee6b-47d0-9258-b1b7c5a3e166 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1752 microversion: 2.1 time: 0.250569 Aug 06 20:51:40.454227 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 573/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:40 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1752 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:41.477450 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:41.478143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:41.484232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:41.484737 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:41.485175 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:41.485855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:41.486300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:41.486767 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:41.633919 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:41.644787 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c7fe3e9e-b1bb-45ef-8a7e-9851c56bcdd6 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.172166 Aug 06 20:51:41.645371 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 570/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:41 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:42.671712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:42.672350 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:42.678653 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:42.679140 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:42.679608 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:42.680335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:42.680846 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:42.681280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:42.819743 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:42.827626 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-580894e0-9b47-49d7-97be-8211aadb81a7 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.159733 Aug 06 20:51:42.828189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 574/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:42 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:43.849886 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:43.850516 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:43.856984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:43.857405 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:43.857839 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:43.858518 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:43.858965 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:43.859418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:44.004260 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:44.012205 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6963b50a-7893-4216-834a-164d91bbf6c0 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.166837 Aug 06 20:51:44.012779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 571/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:43 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:45.033623 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:45.034169 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:45.040581 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:45.041058 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:45.041489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:45.042175 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:45.042628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:45.043051 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:45.183809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:45.192283 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5c505ed1-42ab-4d76-a3bd-a9df7510b606 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.161973 Aug 06 20:51:45.192885 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 575/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:45 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:46.213853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:46.214496 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:46.220844 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:46.221328 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:46.221772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:46.223046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:46.223537 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:46.223967 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:46.368752 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:46.376674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1ea026b1-29c7-4c7a-8f36-bd960b0e385e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.166960 Aug 06 20:51:46.377243 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 572/1147] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:46 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:47.398620 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:47.399237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:47.405567 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:47.406054 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:47.406486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:47.407177 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:47.407660 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:47.408084 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:47.547331 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:47.555123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-14825671-e5db-4f10-bf61-ca08aa42cbce tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.161005 Aug 06 20:51:47.555716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 576/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:47 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:48.575933 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:48.576576 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:48.582917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:48.583433 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:48.583872 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:48.584553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:48.584998 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:48.585415 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:48.728528 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:48.736314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-aceef537-1d96-44f9-aae2-ef9d1186bbc4 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.164279 Aug 06 20:51:48.736877 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 573/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:48 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:49.757633 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:49.758244 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:49.764604 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:49.765086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:49.765520 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:49.766207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:49.766659 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:49.767086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:49.908553 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:49.916468 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-78e8b83e-228f-431c-b5e9-e0e19dc7865d tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.163268 Aug 06 20:51:49.917029 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 577/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:49 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:51:50.937840 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:50.938447 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:50.945438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:50.945917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:50.946348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:50.947027 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:50.947503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:50.948111 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:51.089229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:51.097211 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-717413aa-0703-4df7-a922-b060cb7562e2 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1757 microversion: 2.1 time: 0.163242 Aug 06 20:51:51.097771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 574/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:50 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:51:52.117907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:51:52.118522 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:51:52.125062 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:52.125547 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:52.125986 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:52.126681 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:51:52.127164 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:51:52.127621 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:51:52.269020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:51:52.277487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d67fd429-b9d8-44e4-bc52-dd0af9cddde5 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1760 microversion: 2.1 time: 0.163482 Aug 06 20:51:52.278072 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 578/1152] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:51:52 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:05.069048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:05.069608 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:05.070778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-1065d208-6c7d-44e7-b656-62eae54b1e1b req-570b8864-a9ea-4422-a63d-6181fdbea08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:05.073514 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=12 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:05.074367 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:05.077091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=12 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:05.077912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=36 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:05.079170 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.079702 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.080142 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.080931 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.081577 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.082176 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.085560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-1065d208-6c7d-44e7-b656-62eae54b1e1b req-570b8864-a9ea-4422-a63d-6181fdbea08a service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.086494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-1065d208-6c7d-44e7-b656-62eae54b1e1b req-570b8864-a9ea-4422-a63d-6181fdbea08a service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.086929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-1065d208-6c7d-44e7-b656-62eae54b1e1b req-570b8864-a9ea-4422-a63d-6181fdbea08a service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.098585 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-1065d208-6c7d-44e7-b656-62eae54b1e1b req-570b8864-a9ea-4422-a63d-6181fdbea08a service nova] Creating event network-changed:6ed5e7a9-6704-4da7-8d53-4918b2a196b9 for instance 14b71891-ae29-4234-aa8e-8bd19d79e119 on hv-cinder-85199 Aug 06 20:52:05.103857 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-1065d208-6c7d-44e7-b656-62eae54b1e1b req-570b8864-a9ea-4422-a63d-6181fdbea08a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037330 Aug 06 20:52:05.104473 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 579/1153] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:52:05.113279 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:52:05.196808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-793703e7-fa73-403c-823a-27d1e398c5a8 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 204 len: 0 microversion: 2.1 time: 0.132377 Aug 06 20:52:05.197830 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 575/1154] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:52:05 2022] DELETE /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:52:05.206215 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:05.206916 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:05.213894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.214377 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.214811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.215654 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:05.216110 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:05.216531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:05.351856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:05.359300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-656e9b6c-911c-4265-bbb0-0fe2f44780e7 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.157236 Aug 06 20:52:05.359874 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 580/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:05 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:52:06.382484 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:06.383177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:06.389380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:06.389857 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:06.390291 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:06.390978 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:06.391453 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:06.391875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:06.587597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:06.595203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-82428219-0f69-4ea9-b3e1-62939f38546a tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1569 microversion: 2.1 time: 0.216910 Aug 06 20:52:06.596661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 576/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:06 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:07.600435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-1c28f02f-66d2-4bfc-93fb-6cede02265df req-d53e51db-0047-408b-998f-694abfb0356f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b71891-ae29-4234-aa8e-8bd19d79e119", "name": "network-vif-deleted", "tag": "6ed5e7a9-6704-4da7-8d53-4918b2a196b9"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:07.609256 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-1c28f02f-66d2-4bfc-93fb-6cede02265df req-d53e51db-0047-408b-998f-694abfb0356f service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:07.609732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-1c28f02f-66d2-4bfc-93fb-6cede02265df req-d53e51db-0047-408b-998f-694abfb0356f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:07.610180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-1c28f02f-66d2-4bfc-93fb-6cede02265df req-d53e51db-0047-408b-998f-694abfb0356f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:07.618217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:07.619017 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:07.621571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-1c28f02f-66d2-4bfc-93fb-6cede02265df req-d53e51db-0047-408b-998f-694abfb0356f service nova] Creating event network-vif-deleted:6ed5e7a9-6704-4da7-8d53-4918b2a196b9 for instance 14b71891-ae29-4234-aa8e-8bd19d79e119 on hv-cinder-85199 Aug 06 20:52:07.625622 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:07.626180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:07.626638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-1c28f02f-66d2-4bfc-93fb-6cede02265df req-d53e51db-0047-408b-998f-694abfb0356f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Aug 06 20:52:07.626755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:07.627455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 581/1157] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:52:07.628345 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:07.628996 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:07.629532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:07.694195 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e651cfebd634d5cb2eb6df101c8ac84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74291027525f431293bb7c09c20dab12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:07.702051 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-746340c4-552e-4cef-9803-17df26e4faf4 tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 200 len: 1219 microversion: 2.1 time: 0.088711 Aug 06 20:52:07.702711 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 577/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:07 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:52:08.724503 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:08.725157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] [instance: 14b71891-ae29-4234-aa8e-8bd19d79e119] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:08.731270 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:08.731764 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:08.732217 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:08.732913 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:08.733376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:08.733806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:08.747413 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] HTTP exception thrown: Instance 14b71891-ae29-4234-aa8e-8bd19d79e119 could not be found. Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Request method failure captured: Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 HTTP/1.1 Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tMjCE7Whd_MRUcPwDBLEZkVHpJWl6bmtooAbkBwOLbhfslFve5z4vbAZSDciIjcUIzcGH-fAzfiuaJkjnmEDmsA0DUakSQ0Qb3gP85KO4SgT8eVwndb42uP7e97n3z4tVnQMviWTUwvMJUcEbNpoua7Wps1VLWrUTjavqoF7V2Ulfk Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 74291027525f431293bb7c09c20dab12 Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-TestShelveInstance-2127495224 Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:52:08.749007 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_74291027525f431293bb7c09c20dab12"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/74291027525f431293bb7c09c20dab12"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/74291027525f431293bb7c09c20dab12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/74291027525f431293bb7c09c20dab12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-TestShelveInstance-2127495224 Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 74291027525f431293bb7c09c20dab12 Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-TestShelveInstance-2127495224 Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-TestShelveInstance-2127495224-project Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 1e651cfebd634d5cb2eb6df101c8ac84 Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-TestShelveInstance-2127495224-project Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 14b71891-ae29-4234-aa8e-8bd19d79e119 could not be found. Aug 06 20:52:08.750661 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '14b71891-ae29-4234-aa8e-8bd19d79e119'} Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b71891-ae29-4234-aa8e-8bd19d79e119 could not be found. Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:52:08.751829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b71891-ae29-4234-aa8e-8bd19d79e119 could not be found. Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b71891-ae29-4234-aa8e-8bd19d79e119 could not be found. Aug 06 20:52:08.753372 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:52:08.754752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Returning 404 to user: Instance 14b71891-ae29-4234-aa8e-8bd19d79e119 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:52:08.754752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fdea3107-2ada-4940-aae5-475c78dd476b tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119" status: 404 len: 111 microversion: 2.1 time: 0.031175 Aug 06 20:52:08.754752 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 582/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:08 2022] GET /compute/v2.1/servers/14b71891-ae29-4234-aa8e-8bd19d79e119 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:52:08.904277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4471abda-09de-4656-b539-22d43b8b874f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] Calling method '.version_select at 0x7fba95ec5ca0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:08.923592 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4471abda-09de-4656-b539-22d43b8b874f tempest-TestShelveInstance-2127495224 tempest-TestShelveInstance-2127495224-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1605884297" status: 202 len: 0 microversion: 2.1 time: 0.022996 Aug 06 20:52:08.924172 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 578/1160] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Aug 6 20:52:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1605884297 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:52:20.132268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:52:20.133314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 20:52:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:52:22.336451 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:52:22.337009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:52:25.825276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=8 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:25.826640 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=12 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:26.013137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-41364b36-6343-4b34-82f7-1ec351903d02 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Action: 'create', calling method: .version_select at 0x7fba956b3af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1194858671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnD5wEWLP5zMFJyojzjB00K4HxmRFMpHAmSDSBb4+at+vwg80Y79EkNjlpudJ9LU9QWyUnW9SFnO6lr64kktoPxMIqEqfGr/qURF3qvR1PJqLubFvIgMgm2XKYSsuj7Cg=="}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:26.030809 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-41364b36-6343-4b34-82f7-1ec351903d02 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:52:26.045709 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-41364b36-6343-4b34-82f7-1ec351903d02 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for user 32e65710e03643e981b7e07be5201107 and project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'key_pairs'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:52:26.080838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-41364b36-6343-4b34-82f7-1ec351903d02 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.260315 Aug 06 20:52:26.081498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 583/1161] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 20:52:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:52:36.966708 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:52:36.967396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:52:48.660828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:48.661558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:48.665668 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-167588733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194858671", "security_groups": [{"name": "tempest-secgroup-smoke-1242593605"}], "block_device_mapping_v2": [{"uuid": "fd3fd378-fbcd-4d05-a27e-6e5b4b4f7c8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a9ab2cf4-8c4c-4e84-b1a3-a1ac3f224ca9"}]}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:48.879301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] validate_networks() for [('a9ab2cf4-8c4c-4e84-b1a3-a1ac3f224ca9', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:52:49.324553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:52:49.324964 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:52:49.325443 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:52:49.325858 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:52:49.326277 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:52:49.334986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:49.335513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:49.336559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:49.337292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:49.337748 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:49.338177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:49.355273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:52:49.359384 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for user 32e65710e03643e981b7e07be5201107 and project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:52:49.414875 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:52:49.416984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd3fd378-fbcd-4d05-a27e-6e5b4b4f7c8c',volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:52:49.542813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8210937d-4b1e-41e7-a0a6-1f062f205242 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.883286 Aug 06 20:52:49.543421 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 579/1162] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:52:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:52:49.551721 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=4 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:49.552578 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:49.556928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7e210fd2-57b9-402b-af49-54fd85185fdf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:49.557568 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7e210fd2-57b9-402b-af49-54fd85185fdf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:49.663696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7e210fd2-57b9-402b-af49-54fd85185fdf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:49.671018 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7e210fd2-57b9-402b-af49-54fd85185fdf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1094 microversion: 2.1 time: 0.120728 Aug 06 20:52:49.671596 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 584/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:49 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:50.691177 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:50.691824 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:50.698769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:50.699273 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:50.699972 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:50.700527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:50.700988 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:50.701412 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:50.783989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:50.791903 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c09016a6-fa57-49fb-b4c2-0aa9a158bdf4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1210 microversion: 2.1 time: 0.104609 Aug 06 20:52:50.792465 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 580/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:50 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:51.813391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:51.814629 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:51.822232 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:51.822731 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:51.823170 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:51.823956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:51.824465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:51.824916 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:51.849867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-48ddb2dd-4653-4815-9624-8d2a7e0d5c93 req-e3b5d0df-aa6c-409c-8a93-a956dda7199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edd387a-5c28-447f-8716-7819f66574c7", "tag": "c4609718-46ba-40b2-bc9c-4e8b83495f12"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:51.861686 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-48ddb2dd-4653-4815-9624-8d2a7e0d5c93 req-e3b5d0df-aa6c-409c-8a93-a956dda7199f service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:51.862454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-48ddb2dd-4653-4815-9624-8d2a7e0d5c93 req-e3b5d0df-aa6c-409c-8a93-a956dda7199f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:51.862881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-48ddb2dd-4653-4815-9624-8d2a7e0d5c93 req-e3b5d0df-aa6c-409c-8a93-a956dda7199f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:51.874987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-48ddb2dd-4653-4815-9624-8d2a7e0d5c93 req-e3b5d0df-aa6c-409c-8a93-a956dda7199f service nova] Creating event network-changed:c4609718-46ba-40b2-bc9c-4e8b83495f12 for instance 4edd387a-5c28-447f-8716-7819f66574c7 on hv-cinder-85199 Aug 06 20:52:51.879842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-48ddb2dd-4653-4815-9624-8d2a7e0d5c93 req-e3b5d0df-aa6c-409c-8a93-a956dda7199f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034469 Aug 06 20:52:51.880431 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 581/1165] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:52:52.059516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:52.066983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-3af5054d-ed67-41a1-935a-15ae28d29f99 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.257577 Aug 06 20:52:52.067582 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 585/1166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:51 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:53.089582 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:53.090310 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:53.096440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:53.096929 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:53.097369 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:53.098059 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:53.098511 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:53.098935 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:53.229361 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:53.236734 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ff71d02a-5a2f-445e-98dc-d1bbbea274bf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.152077 Aug 06 20:52:53.237296 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 582/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:53 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:54.256971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:54.258396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:54.265183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:54.265664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:54.266094 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:54.266778 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:54.267228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:54.267672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:54.399889 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:54.407193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7c134781-502a-4669-9b98-781b16c080cd tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.154054 Aug 06 20:52:54.407766 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 586/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:54 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:55.427439 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:55.428044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:55.436632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:55.437261 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:55.437704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:55.438406 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:55.438863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:55.439344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:55.569164 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:55.576438 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-7fd5a0f1-5ad2-41fc-aee9-c43d984bca39 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.152900 Aug 06 20:52:55.576986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 583/1169] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:55 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:55.741222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1922023646"}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:55.741793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:55.748241 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:55.748719 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:55.749147 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:55.749831 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:55.750280 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:55.750700 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:55.876183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.network.security_group_api [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Removing security group e9857249-50f4-4ced-ae67-a45db42140c2 from port 00296fb9-b65a-446f-89ad-28c6311d1609 Aug 06 20:52:56.171780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c6d5f3b2-6345-466a-b4a6-c66744bda1a8 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/action" status: 202 len: 0 microversion: 2.1 time: 0.434346 Aug 06 20:52:56.172389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 587/1170] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 20:52:55 2022] POST /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:52:56.179793 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-ebc8f383-1875-490d-a274-2994c5c66e54 req-b90ec817-6714-4e1d-8985-b9ecfe45242d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:56.189084 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-ebc8f383-1875-490d-a274-2994c5c66e54 req-b90ec817-6714-4e1d-8985-b9ecfe45242d service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:56.189558 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-ebc8f383-1875-490d-a274-2994c5c66e54 req-b90ec817-6714-4e1d-8985-b9ecfe45242d service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:56.189986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-ebc8f383-1875-490d-a274-2994c5c66e54 req-b90ec817-6714-4e1d-8985-b9ecfe45242d service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:56.202001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-ebc8f383-1875-490d-a274-2994c5c66e54 req-b90ec817-6714-4e1d-8985-b9ecfe45242d service nova] Creating event network-changed:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:52:56.207383 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-ebc8f383-1875-490d-a274-2994c5c66e54 req-b90ec817-6714-4e1d-8985-b9ecfe45242d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031133 Aug 06 20:52:56.207986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 584/1171] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:52:56.603430 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:56.604081 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:56.610289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:56.610774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:56.611207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:56.611930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:56.612385 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:56.612806 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:56.840157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:56.847642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d4a2c6f8-93a0-4359-886f-cf3167f84489 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.254542 Aug 06 20:52:56.848713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 588/1172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:56 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:57.412205 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:57.412815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:57.420294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.420961 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.421499 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:57.422353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.422952 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.423593 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:57.478211 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-0589022e-1ce7-49e1-b5b9-3447b4cd6b1d req-03596ca9-2183-4091-9a1f-4abed29d3964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:52:57.487644 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0589022e-1ce7-49e1-b5b9-3447b4cd6b1d req-03596ca9-2183-4091-9a1f-4abed29d3964 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.488336 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0589022e-1ce7-49e1-b5b9-3447b4cd6b1d req-03596ca9-2183-4091-9a1f-4abed29d3964 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.488765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-0589022e-1ce7-49e1-b5b9-3447b4cd6b1d req-03596ca9-2183-4091-9a1f-4abed29d3964 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:57.501005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-0589022e-1ce7-49e1-b5b9-3447b4cd6b1d req-03596ca9-2183-4091-9a1f-4abed29d3964 service nova] Creating event network-changed:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:52:57.508921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-0589022e-1ce7-49e1-b5b9-3447b4cd6b1d req-03596ca9-2183-4091-9a1f-4abed29d3964 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090993 Aug 06 20:52:57.511696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 589/1173] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:52:57.515001 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.objects.instance [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lazy-loading 'services' on Instance uuid fd058500-fd7e-49a4-bc12-91fa2b8eae9f {{(pid=129476) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:52:57.603129 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6f0d1af5-a2b8-417b-bf82-3ad8fce77b65 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments/04120ff1-3c9d-40fe-a6f7-0566e8b87738" status: 202 len: 0 microversion: 2.1 time: 0.194341 Aug 06 20:52:57.607507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 585/1174] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:52:57 2022] DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments/04120ff1-3c9d-40fe-a6f7-0566e8b87738 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:52:57.614344 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:57.616849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:57.629609 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.630105 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.630538 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:57.631298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.631757 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.632181 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:57.664347 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-98427891-0843-4e93-bdb6-f7eab4445957 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055685 Aug 06 20:52:57.665288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 590/1175] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:52:57 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:52:57.870373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:57.871057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:57.877694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.878192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.878629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:57.879381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:57.879847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:57.880270 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:58.019161 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:58.027811 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-dd780e3e-6d63-48fb-a778-a2fc0529d18c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.162267 Aug 06 20:52:58.028379 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 586/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:57 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:58.676288 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:58.678476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:58.684839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:58.685323 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:58.685760 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:58.686452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:58.686910 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:58.687362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:58.715931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-85ca0554-ef6d-48e0-961a-cdff8ece8d7e tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Aug 06 20:52:58.716486 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 591/1177] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:52:58 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 20:52:59.047559 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:59.048130 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:59.054762 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.055268 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.055704 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.056392 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.056867 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.057287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.185632 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:52:59.193480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5061ea1d-cd7b-4a1e-bfb2-47332bbe216f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.149749 Aug 06 20:52:59.194046 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 587/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:52:59 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:52:59.728780 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:59.730945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:59.732946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:59.738462 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.738953 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.739420 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.740136 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.740590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.741009 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.769645 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-34a13d79-4a79-47c6-bfd1-3dd270d14065 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045326 Aug 06 20:52:59.770200 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 592/1179] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 20:52:59 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 20:52:59.780463 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:52:59.781143 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:52:59.783069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:59.783757 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:59.790455 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.790941 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.791430 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.792125 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:52:59.792578 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:52:59.793009 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:52:59.875577 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] HTTP exception thrown: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f is not attached to volume 04120ff1-3c9d-40fe-a6f7-0566e8b87738 Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Request method failure captured: Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments/04120ff1-3c9d-40fe-a6f7-0566e8b87738 HTTP/1.1 Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tPkMRxo4HvVvgHZY-H6WZ4O_LTKM1Kpyj6SWKFGbJxV38gM8-dWPwQV60wGLDWA7HMSbtPmvKzt8Uhi5MzB7lScnmQ76hpaM1eZwJQwe5uUSjmcL6hTx40Nfucx5GfGzsBDFUu0iFZBAw670_7tKX8FS1cAviBT53SuNZCLcK1fSXI Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: 018934fef0f0449aa106919333cf9d1e Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-TestMinimumBasicScenario-1933505334 Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:52:59.877939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_018934fef0f0449aa106919333cf9d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/018934fef0f0449aa106919333cf9d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/018934fef0f0449aa106919333cf9d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/018934fef0f0449aa106919333cf9d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-TestMinimumBasicScenario-1933505334 Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: 018934fef0f0449aa106919333cf9d1e Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1933505334 Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-TestMinimumBasicScenario-1933505334-project Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: fdeed99b63844142981d0e8ce3afc850 Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-TestMinimumBasicScenario-1933505334-project Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:52:59.879722 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f is not attached to volume 04120ff1-3c9d-40fe-a6f7-0566e8b87738 Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'server_id': 'fd058500-fd7e-49a4-bc12-91fa2b8eae9f', 'id': '04120ff1-3c9d-40fe-a6f7-0566e8b87738'} Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04120ff1-3c9d-40fe-a6f7-0566e8b87738. Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:52:59.880853 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f is not attached to volume 04120ff1-3c9d-40fe-a6f7-0566e8b87738 Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f is not attached to volume 04120ff1-3c9d-40fe-a6f7-0566e8b87738 Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:52:59.882510 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Returning 404 to user: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f is not attached to volume 04120ff1-3c9d-40fe-a6f7-0566e8b87738 {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:52:59.883923 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ddaa8684-14f5-414c-9fbc-8fef2735ef1f tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments/04120ff1-3c9d-40fe-a6f7-0566e8b87738" status: 404 len: 154 microversion: 2.1 time: 0.102888 Aug 06 20:52:59.883923 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 588/1180] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 20:52:59 2022] DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f/os-volume_attachments/04120ff1-3c9d-40fe-a6f7-0566e8b87738 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:53:00.217540 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:00.218097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:00.224015 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:00.224499 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:00.224956 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:00.225646 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:00.226758 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:00.227201 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:00.361317 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:00.369365 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-95294878-26f5-4445-a0cc-1b25fbf39312 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.155748 Aug 06 20:53:00.369925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 593/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:00 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:01.015135 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:01.015733 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:01.022071 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:01.022552 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:01.023652 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:01.024265 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:01.024718 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:01.025140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:01.050742 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:53:01.126621 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-9b1c5fa2-3f37-4e8e-ba17-39aa9a8e87ab tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 204 len: 0 microversion: 2.1 time: 0.115188 Aug 06 20:53:01.127353 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 589/1182] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:53:01 2022] DELETE /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:53:01.142061 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:01.142602 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:01.149771 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:01.150281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:01.150727 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:01.151465 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:01.151929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:01.152362 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:01.278511 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:01.286041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-7a20b1bb-b450-4e27-8a65-025a45ff5cdf tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1554 microversion: 2.1 time: 0.154079 Aug 06 20:53:01.286607 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 594/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:01 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:01.389355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:01.390048 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:01.395984 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:01.396409 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:01.396847 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:01.397539 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:01.397992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:01.398416 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:01.531348 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:01.539513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6182347c-bf4e-4f36-9002-5ceb63f258c6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.154290 Aug 06 20:53:01.540085 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 590/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:01 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:02.308024 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:02.308571 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:02.314908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:02.315424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:02.315862 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:02.316553 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:02.317011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:02.317440 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:02.443936 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:02.451946 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6710f0df-43bf-46d9-a813-93d935e41461 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1554 microversion: 2.1 time: 0.148379 Aug 06 20:53:02.452508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 595/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:02 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:53:02.560440 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:02.560962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:02.567297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:02.567780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:02.568210 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:02.568893 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:02.569344 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:02.570289 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:02.699939 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:02.707290 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4a81b1ed-1f8d-44de-ae0c-a66557eb1f52 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.150940 Aug 06 20:53:02.707850 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 591/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:02 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:53:03.099730 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-792fe89f-45f3-4398-b244-501726f104e3 req-2bca28df-5b70-44cf-a38c-8d8f17978d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edd387a-5c28-447f-8716-7819f66574c7", "name": "network-vif-plugged", "status": "completed", "tag": "c4609718-46ba-40b2-bc9c-4e8b83495f12"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:03.109228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-792fe89f-45f3-4398-b244-501726f104e3 req-2bca28df-5b70-44cf-a38c-8d8f17978d2d service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:03.110130 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-792fe89f-45f3-4398-b244-501726f104e3 req-2bca28df-5b70-44cf-a38c-8d8f17978d2d service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:03.110371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-792fe89f-45f3-4398-b244-501726f104e3 req-2bca28df-5b70-44cf-a38c-8d8f17978d2d service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:03.122834 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-792fe89f-45f3-4398-b244-501726f104e3 req-2bca28df-5b70-44cf-a38c-8d8f17978d2d service nova] Creating event network-vif-plugged:c4609718-46ba-40b2-bc9c-4e8b83495f12 for instance 4edd387a-5c28-447f-8716-7819f66574c7 on hv-cinder-85199 Aug 06 20:53:03.127793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-792fe89f-45f3-4398-b244-501726f104e3 req-2bca28df-5b70-44cf-a38c-8d8f17978d2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087693 Aug 06 20:53:03.128364 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 596/1187] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:03.473338 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:03.473947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:03.479813 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:03.480292 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:03.480723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:03.481407 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:03.481856 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:03.482278 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:03.728563 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:03.729983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:03.730818 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:03.736114 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4b11c4c1-cc3c-4ffb-b06d-4c683369266a tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1554 microversion: 2.1 time: 0.266569 Aug 06 20:53:03.736684 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 592/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:03 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1554 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:03.736838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:03.737324 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:03.737849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:03.738447 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:03.738921 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:03.739371 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:03.944226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:03.951706 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-53107558-40c0-466a-8a9e-331f488bfe1a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.226960 Aug 06 20:53:03.952273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 597/1189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:03 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:53:04.049717 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-f44f69b5-1b46-488b-a7fb-2884f431c1ea req-1f177604-ba3e-4df2-b1b6-89353f157518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd058500-fd7e-49a4-bc12-91fa2b8eae9f", "name": "network-vif-deleted", "tag": "00296fb9-b65a-446f-89ad-28c6311d1609"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:04.058938 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-f44f69b5-1b46-488b-a7fb-2884f431c1ea req-1f177604-ba3e-4df2-b1b6-89353f157518 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:04.059447 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-f44f69b5-1b46-488b-a7fb-2884f431c1ea req-1f177604-ba3e-4df2-b1b6-89353f157518 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:04.059876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-f44f69b5-1b46-488b-a7fb-2884f431c1ea req-1f177604-ba3e-4df2-b1b6-89353f157518 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:04.071201 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-f44f69b5-1b46-488b-a7fb-2884f431c1ea req-1f177604-ba3e-4df2-b1b6-89353f157518 service nova] Creating event network-vif-deleted:00296fb9-b65a-446f-89ad-28c6311d1609 for instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f on hv-cinder-85199 Aug 06 20:53:04.075948 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-f44f69b5-1b46-488b-a7fb-2884f431c1ea req-1f177604-ba3e-4df2-b1b6-89353f157518 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Aug 06 20:53:04.076503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 593/1190] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:53:04.757039 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:04.757694 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:04.764109 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:04.764599 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:04.765041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:04.765736 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:04.766193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:04.766621 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:04.796876 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:04.797355 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:04.797793 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:04.798242 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lazy-loading 'fault' on Instance uuid fd058500-fd7e-49a4-bc12-91fa2b8eae9f {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:53:04.838777 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdeed99b63844142981d0e8ce3afc850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '018934fef0f0449aa106919333cf9d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:04.846168 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b10c9279-66d1-4e20-86c3-55d8deab28e9 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 200 len: 1349 microversion: 2.1 time: 0.093020 Aug 06 20:53:04.846737 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 598/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:04 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:04.973808 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:04.974425 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:04.980927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:04.981436 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:04.981872 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:04.982562 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:04.983024 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:04.983482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:05.117118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:05.125815 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-afc7dd9b-1e73-45fe-8d74-c191f2ba78fa tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1266 microversion: 2.1 time: 0.156768 Aug 06 20:53:05.126381 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 594/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:04 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:05.867870 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:05.868391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] [instance: fd058500-fd7e-49a4-bc12-91fa2b8eae9f] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:05.874880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:05.875394 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:05.875829 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:05.876515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:05.876967 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:05.877386 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:05.890928 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] HTTP exception thrown: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f could not be found. Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Request method failure captured: Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f HTTP/1.1 Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tPkMRxo4HvVvgHZY-H6WZ4O_LTKM1Kpyj6SWKFGbJxV38gM8-dWPwQV60wGLDWA7HMSbtPmvKzt8Uhi5MzB7lScnmQ76hpaM1eZwJQwe5uUSjmcL6hTx40Nfucx5GfGzsBDFUu0iFZBAw670_7tKX8FS1cAviBT53SuNZCLcK1fSXI Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: 018934fef0f0449aa106919333cf9d1e Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-TestMinimumBasicScenario-1933505334 Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 20:53:05.892592 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_018934fef0f0449aa106919333cf9d1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/018934fef0f0449aa106919333cf9d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/018934fef0f0449aa106919333cf9d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/018934fef0f0449aa106919333cf9d1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-TestMinimumBasicScenario-1933505334 Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: 018934fef0f0449aa106919333cf9d1e Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1933505334 Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-TestMinimumBasicScenario-1933505334-project Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: fdeed99b63844142981d0e8ce3afc850 Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-TestMinimumBasicScenario-1933505334-project Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f could not be found. Aug 06 20:53:05.894335 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': 'fd058500-fd7e-49a4-bc12-91fa2b8eae9f'} Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f could not be found. Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:53:05.895198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f could not be found. Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f could not be found. Aug 06 20:53:05.896847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 20:53:05.898945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Returning 404 to user: Instance fd058500-fd7e-49a4-bc12-91fa2b8eae9f could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:53:05.898945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-af3664df-f123-494a-9910-1adb7d8b5256 tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f" status: 404 len: 111 microversion: 2.1 time: 0.030039 Aug 06 20:53:05.898945 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 599/1193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:05 2022] GET /compute/v2.1/servers/fd058500-fd7e-49a4-bc12-91fa2b8eae9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:53:05.903167 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c9dcea0d-ec55-4ea6-9d4c-3e89a70b34dc tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] Calling method '.version_select at 0x7fba95ee8790>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:05.921297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c9dcea0d-ec55-4ea6-9d4c-3e89a70b34dc tempest-TestMinimumBasicScenario-1933505334 tempest-TestMinimumBasicScenario-1933505334-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1321080374" status: 202 len: 0 microversion: 2.1 time: 0.021849 Aug 06 20:53:05.921833 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 595/1194] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Aug 6 20:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1321080374 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 20:53:06.145888 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:06.146509 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:06.152896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:06.153391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:06.153839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:06.154531 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:06.154989 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:06.155459 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:06.298005 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:06.305732 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-515562f2-da85-4a04-9ff3-39d0a36ad134 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1453 microversion: 2.1 time: 0.163707 Aug 06 20:53:06.306294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 600/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:06 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:06.327680 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:53:06.328380 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:53:06.334408 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:06.334894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:06.335418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:06.336899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:06.337346 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:06.337779 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:06.473479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:53:06.477044 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:06.481881 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-deef6900-cfef-4d79-ada5-fbef1c1cb896 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1453 microversion: 2.1 time: 0.159257 Aug 06 20:53:06.482446 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 596/1196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:53:06 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:53:08.497006 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-014ad427-96a6-42fa-a9c2-01910cc40958 req-9d3c5a1d-aa2f-4c7c-9a21-078e5428dd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4edd387a-5c28-447f-8716-7819f66574c7", "tag": "c4609718-46ba-40b2-bc9c-4e8b83495f12"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:53:08.508583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-014ad427-96a6-42fa-a9c2-01910cc40958 req-9d3c5a1d-aa2f-4c7c-9a21-078e5428dd6b service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:53:08.509403 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-014ad427-96a6-42fa-a9c2-01910cc40958 req-9d3c5a1d-aa2f-4c7c-9a21-078e5428dd6b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:53:08.510040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-014ad427-96a6-42fa-a9c2-01910cc40958 req-9d3c5a1d-aa2f-4c7c-9a21-078e5428dd6b service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:53:08.522031 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-014ad427-96a6-42fa-a9c2-01910cc40958 req-9d3c5a1d-aa2f-4c7c-9a21-078e5428dd6b service nova] Creating event network-changed:c4609718-46ba-40b2-bc9c-4e8b83495f12 for instance 4edd387a-5c28-447f-8716-7819f66574c7 on hv-cinder-85199 Aug 06 20:53:08.528434 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-014ad427-96a6-42fa-a9c2-01910cc40958 req-9d3c5a1d-aa2f-4c7c-9a21-078e5428dd6b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035405 Aug 06 20:53:08.529473 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 601/1197] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:22.288507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ddd53b1e-7eb5-48a0-8b60-783c6876cdb5] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 06 20:55:22.289336 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:22.293192 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.293675 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:22.301232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.301713 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.302145 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.302827 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.303300 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.303723 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.328888 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:55:22.401294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1f42c82d-c38b-4f88-afbc-4ddc53743b42 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 204 len: 0 microversion: 2.1 time: 0.115059 Aug 06 20:55:22.401874 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 597/1198] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:55:22 2022] DELETE /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:55:22.408302 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28cd0d65-7596-4ecc-80d8-344444d8d96a] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 06 20:55:22.409856 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=40 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:22.410649 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=86 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:22.414647 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:22.415369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:22.422080 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.422565 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.423000 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.423714 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:22.424171 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:22.425236 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:22.558396 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:22.566546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9169617c-52e7-436b-a584-b7cc31962aa2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1577 microversion: 2.1 time: 0.160238 Aug 06 20:55:22.567138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 602/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:22 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:23.588774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:23.589478 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:23.597735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:23.598225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:23.598665 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:23.599394 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:23.599855 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:23.600287 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:23.605801 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] [ddd53b1e-7eb5-48a0-8b60-783c6876cdb5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38028. Aug 06 20:55:23.735915 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:23.744252 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d6b34a72-1938-45d7-8eb3-9067ae1a485c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1577 microversion: 2.1 time: 0.160043 Aug 06 20:55:23.744849 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 598/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:23 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:24.765100 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:24.765712 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:24.773586 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.774168 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.774753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.775548 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:24.776070 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:24.776566 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:24.793950 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] [28cd0d65-7596-4ecc-80d8-344444d8d96a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38032. Aug 06 20:55:25.024042 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:25.032232 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-cae8e948-ff79-4794-88d3-924aaa406f6e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1577 microversion: 2.1 time: 0.270993 Aug 06 20:55:25.032838 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 603/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:24 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:25.471963 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-3fe5063d-b0b2-4c2c-ab7b-14de2b6cf9c5 req-db689874-f20e-443a-84ef-fb5466d59ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4edd387a-5c28-447f-8716-7819f66574c7", "name": "network-vif-deleted", "tag": "c4609718-46ba-40b2-bc9c-4e8b83495f12"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:25.481184 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3fe5063d-b0b2-4c2c-ab7b-14de2b6cf9c5 req-db689874-f20e-443a-84ef-fb5466d59ea6 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:25.481669 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3fe5063d-b0b2-4c2c-ab7b-14de2b6cf9c5 req-db689874-f20e-443a-84ef-fb5466d59ea6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:25.482102 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-3fe5063d-b0b2-4c2c-ab7b-14de2b6cf9c5 req-db689874-f20e-443a-84ef-fb5466d59ea6 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:25.493251 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-3fe5063d-b0b2-4c2c-ab7b-14de2b6cf9c5 req-db689874-f20e-443a-84ef-fb5466d59ea6 service nova] Creating event network-vif-deleted:c4609718-46ba-40b2-bc9c-4e8b83495f12 for instance 4edd387a-5c28-447f-8716-7819f66574c7 on hv-cinder-85199 Aug 06 20:55:25.497920 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-3fe5063d-b0b2-4c2c-ab7b-14de2b6cf9c5 req-db689874-f20e-443a-84ef-fb5466d59ea6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245154 Aug 06 20:55:25.498578 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 599/1202] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:26.053981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:26.054794 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:26.062187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.062677 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.063114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.064521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.065090 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.065544 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.104419 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:26.104912 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:26.105356 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:26.105814 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.objects.instance [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lazy-loading 'fault' on Instance uuid 4edd387a-5c28-447f-8716-7819f66574c7 {{(pid=129475) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 20:55:26.151312 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:26.158348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d3be72c3-c526-4330-b149-e5b3747a186d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 200 len: 1184 microversion: 2.1 time: 0.109785 Aug 06 20:55:26.159493 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 604/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:26 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 1184 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:27.181329 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:27.182023 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:27.188064 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:27.188573 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:27.189008 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.189696 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:27.190713 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:27.191140 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.204897 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] HTTP exception thrown: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Request method failure captured: Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 HTTP/1.1 Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tSEGfvQnl5C7eCHomz0pgcBGoKn7OIH2wGAaf-uoe8x0BJjn3gZ3PeoeTgeuCLtSIZj4pZVmkFMSp-8MeqoOUK2Fgx9ZHGQokIBmFPzWx-qVlADa6bSJRl9IJJGBmUm6sVLcfSwm2C1aL507ACqu7QpEEQwbPgvv2RHlOPzxBWYkec Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 20:55:27.206494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-TestVolumeBootPattern-1894955532 Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-TestVolumeBootPattern-1894955532-project Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 32e65710e03643e981b7e07be5201107 Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-TestVolumeBootPattern-1894955532-project Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 20:55:27.208294 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '4edd387a-5c28-447f-8716-7819f66574c7'} Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 20:55:27.209355 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 20:55:27.210977 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 20:55:27.212765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Returning 404 to user: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 20:55:27.212765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c0d87056-37f2-4ed8-9895-8235754a7422 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 404 len: 111 microversion: 2.1 time: 0.031221 Aug 06 20:55:27.212765 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 600/1204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:27 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 20:55:27.300334 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-534212982", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194858671", "security_groups": [{"name": "tempest-secgroup-smoke-1242593605"}], "block_device_mapping_v2": [{"uuid": "fd3fd378-fbcd-4d05-a27e-6e5b4b4f7c8c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a9ab2cf4-8c4c-4e84-b1a3-a1ac3f224ca9"}]}} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:27.412424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.network.neutron [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] validate_networks() for [('a9ab2cf4-8c4c-4e84-b1a3-a1ac3f224ca9', None, None, None, None, None)] {{(pid=129475) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:55:27.863811 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Flavor limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:55:27.864245 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Image limits 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:55:27.864728 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Flavor pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:55:27.865144 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Image pref 0:0:0 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:55:27.865562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.virt.hardware [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129475) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:55:27.874300 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:27.874789 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:27.875228 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.875989 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:27.876452 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:27.876884 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:27.894046 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:55:27.898027 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.quota [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for user 32e65710e03643e981b7e07be5201107 and project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'instances', 'ram', 'cores'} {{(pid=129475) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:55:27.954137 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Going to run 1 instances... {{(pid=129475) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:55:27.956770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd3fd378-fbcd-4d05-a27e-6e5b4b4f7c8c',volume_size=None,volume_type=None)] {{(pid=129475) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:55:28.082152 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a7843989-966c-4807-9a59-3a84d3666078 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.786074 Aug 06 20:55:28.082791 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 605/1205] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:55:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:55:28.093611 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-71c7f528-635d-42f8-b07d-c7d8c9242d94 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:28.094226 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-71c7f528-635d-42f8-b07d-c7d8c9242d94 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:28.146301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-71c7f528-635d-42f8-b07d-c7d8c9242d94 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:28.152772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-71c7f528-635d-42f8-b07d-c7d8c9242d94 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1094 microversion: 2.1 time: 0.062951 Aug 06 20:55:28.153325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 601/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:28 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:29.173849 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-6dae2d5e-f5c8-4c9c-b9b6-c60a45bad738 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:29.175085 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-6dae2d5e-f5c8-4c9c-b9b6-c60a45bad738 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:29.231847 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-6dae2d5e-f5c8-4c9c-b9b6-c60a45bad738 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:29.238572 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-6dae2d5e-f5c8-4c9c-b9b6-c60a45bad738 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1094 microversion: 2.1 time: 0.069053 Aug 06 20:55:29.239123 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 606/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:29 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:30.258624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-27207d44-bb03-4af6-9dff-c177918828e8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:30.259168 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-27207d44-bb03-4af6-9dff-c177918828e8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:30.311780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-27207d44-bb03-4af6-9dff-c177918828e8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:30.318947 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-27207d44-bb03-4af6-9dff-c177918828e8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1094 microversion: 2.1 time: 0.064259 Aug 06 20:55:30.319538 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 602/1208] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:30 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:31.339815 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-c31f5728-6b3e-4bf2-aa55-add9d691290a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:31.340542 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-c31f5728-6b3e-4bf2-aa55-add9d691290a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:31.391944 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-c31f5728-6b3e-4bf2-aa55-add9d691290a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:31.398528 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-c31f5728-6b3e-4bf2-aa55-add9d691290a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1094 microversion: 2.1 time: 0.062889 Aug 06 20:55:31.399086 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 607/1209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:31 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:32.419124 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:32.419777 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:32.426731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.427215 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.427674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.428356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:32.428817 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:32.429243 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:32.490728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:32.498250 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b5b498e4-0228-4413-b558-f842a75e8465 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1144 microversion: 2.1 time: 0.082989 Aug 06 20:55:32.498819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 603/1210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:32 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:33.519588 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:33.520126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:33.527454 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.527915 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.528339 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.529369 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:33.529466 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:33.529880 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:33.622579 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:33.630480 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-82833d56-4f64-4d56-a405-824311650bc3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1210 microversion: 2.1 time: 0.114934 Aug 06 20:55:33.631036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 608/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:33 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:34.588402 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-70482da9-e29d-4aec-8bf1-223572cf159a req-9d82d682-c4e4-40ed-b2e2-aca4a5174a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b20bc77-0816-42d3-bd06-70e4f233df8e", "tag": "169aa661-65f0-43e4-ac19-f02fcb3c8269"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:34.602422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-70482da9-e29d-4aec-8bf1-223572cf159a req-9d82d682-c4e4-40ed-b2e2-aca4a5174a00 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.602751 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-70482da9-e29d-4aec-8bf1-223572cf159a req-9d82d682-c4e4-40ed-b2e2-aca4a5174a00 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.603289 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-70482da9-e29d-4aec-8bf1-223572cf159a req-9d82d682-c4e4-40ed-b2e2-aca4a5174a00 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.616643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-70482da9-e29d-4aec-8bf1-223572cf159a req-9d82d682-c4e4-40ed-b2e2-aca4a5174a00 service nova] Creating event network-changed:169aa661-65f0-43e4-ac19-f02fcb3c8269 for instance 7b20bc77-0816-42d3-bd06-70e4f233df8e on hv-cinder-85199 Aug 06 20:55:34.621454 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-70482da9-e29d-4aec-8bf1-223572cf159a req-9d82d682-c4e4-40ed-b2e2-aca4a5174a00 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037083 Aug 06 20:55:34.622037 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 604/1212] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:34.651532 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:34.652145 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:34.658837 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.659391 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.659841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.660577 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:34.661120 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:34.663738 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:34.870413 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:34.878297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5952eea0-cd57-4b7b-ae17-e76bc1c6a452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.230736 Aug 06 20:55:34.879053 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 609/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:34 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:35.899601 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:35.900357 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:35.906356 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.906854 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.907293 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:35.907975 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:35.908424 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:35.908842 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:36.134229 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:36.141694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-247c8d14-5a55-4483-9d16-e87306401e73 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.246700 Aug 06 20:55:36.142259 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 605/1214] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:35 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:37.163972 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:37.164590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:37.171003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.171522 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.171958 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.172648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:37.173134 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:37.173563 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:37.305464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:37.313129 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-fca0f568-eff8-448e-aed1-05cba1cf814c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.152965 Aug 06 20:55:37.313691 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 610/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:37 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:38.334792 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:38.335427 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:38.342134 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.342629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.343045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.343754 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:38.344203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:38.344624 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:38.470680 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:38.478729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-67e70cb7-e217-4be2-8a07-bced8616703b tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.148292 Aug 06 20:55:38.479304 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 606/1216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:38 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:39.503813 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:39.504449 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:39.506279 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:39.511970 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.512478 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.512894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.513587 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:39.514041 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:39.514487 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:39.643933 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:39.651382 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-00bb6bae-1def-44e2-9bf3-088e361ecb09 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.151567 Aug 06 20:55:39.651943 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 611/1217] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:39 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:40.143618 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:55:40.144128 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 20:55:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:55:40.671688 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:40.672297 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:40.675050 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=4 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:40.680422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.680901 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.681335 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.682021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:40.682471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:40.682894 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:40.809631 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:40.817532 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-ab18be28-9ccd-4ece-b497-1a7b566f307e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.149695 Aug 06 20:55:40.818089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 607/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:40 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:41.840345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:41.840964 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:41.843281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=10 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:41.849345 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.849840 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.850269 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.850961 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:41.851444 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:41.851867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:41.984322 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:41.992368 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-54a7a26b-0f8f-4cc2-ac27-e9a80364cfe3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.156153 Aug 06 20:55:41.992931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 612/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:41 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:42.345091 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:55:42.345327 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:55:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:55:43.013138 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:43.013692 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:43.020227 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.020702 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.021136 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.021817 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:43.022267 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:43.022694 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:43.149774 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:43.157153 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-474e596d-4fc9-4b14-829b-43ee16a6510f tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.148273 Aug 06 20:55:43.157710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 608/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:43 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:44.178397 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:44.179011 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:44.185424 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.185899 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.186325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.187003 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:44.187477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:44.187896 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:44.318162 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:44.325515 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d0ef08ef-3ca9-4d43-aa97-86d7b793e91c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.150959 Aug 06 20:55:44.326068 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 613/1221] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:44 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:45.347990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:45.348586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:45.354942 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.355474 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.355917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.356610 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.357069 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.357498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.498435 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:45.505753 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c5102c1d-2434-4c30-a26a-f63a2fb94b9c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.163443 Aug 06 20:55:45.506323 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 609/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:45 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:45.879482 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b20bc77-0816-42d3-bd06-70e4f233df8e", "name": "network-vif-plugged", "status": "completed", "tag": "169aa661-65f0-43e4-ac19-f02fcb3c8269"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:45.889726 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:45.890243 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:45.890672 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:45.902664 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] Creating event network-vif-plugged:169aa661-65f0-43e4-ac19-f02fcb3c8269 for instance 7b20bc77-0816-42d3-bd06-70e4f233df8e on hv-cinder-85199 Aug 06 20:55:45.906153 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR oslo.messaging._drivers.impl_rabbit [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] [7e48e644-e6bd-46fc-8617-040b401a83c5] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 20:55:46.525906 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:46.526498 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:46.532895 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.533379 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.533812 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.534507 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:46.534962 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:46.535418 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:46.665422 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:46.672828 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-3012a805-eb80-4bd3-b580-c3696b3aa3b0 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.150789 Aug 06 20:55:46.673386 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 610/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:46 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:46.915489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] [7e48e644-e6bd-46fc-8617-040b401a83c5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38130. Aug 06 20:55:46.918867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-79e1b980-64bc-4721-a9ea-c96832dc6c14 req-38445cb0-59e2-4fe7-ae11-b97af5f8e93f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043471 Aug 06 20:55:46.919512 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 614/1224] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:55:47.694015 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:47.694654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:47.701037 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.701525 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.701961 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.702655 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:47.703107 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:47.703582 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:47.831876 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:47.839616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-5b25c6a3-10da-4494-954b-d98342830131 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1266 microversion: 2.1 time: 0.149340 Aug 06 20:55:47.840174 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 611/1225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:47 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:48.862925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:48.865947 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:48.871101 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.871651 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.872085 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:48.872782 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:48.873231 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:48.873655 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.004698 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.012216 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-897758ae-4baf-472c-b218-48f89378892a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1452 microversion: 2.1 time: 0.154733 Aug 06 20:55:49.012775 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 615/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:48 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:55:49.031900 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:55:49.032512 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:55:49.038848 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.039365 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.039805 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.040494 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:49.040949 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:49.041373 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:49.182838 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:55:49.190886 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-fbb04321-d08b-4bbd-ae79-d5a9c0e06477 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1452 microversion: 2.1 time: 0.162787 Aug 06 20:55:49.191534 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 612/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:55:49 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:55:50.747285 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-23a3146e-4f67-4d58-8dac-ddbc5871f238 req-a1391c6b-451b-4edb-bc67-261357384164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b20bc77-0816-42d3-bd06-70e4f233df8e", "tag": "169aa661-65f0-43e4-ac19-f02fcb3c8269"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:55:50.757926 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-23a3146e-4f67-4d58-8dac-ddbc5871f238 req-a1391c6b-451b-4edb-bc67-261357384164 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:55:50.758595 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-23a3146e-4f67-4d58-8dac-ddbc5871f238 req-a1391c6b-451b-4edb-bc67-261357384164 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:55:50.759059 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-23a3146e-4f67-4d58-8dac-ddbc5871f238 req-a1391c6b-451b-4edb-bc67-261357384164 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:55:50.770920 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-23a3146e-4f67-4d58-8dac-ddbc5871f238 req-a1391c6b-451b-4edb-bc67-261357384164 service nova] Creating event network-changed:169aa661-65f0-43e4-ac19-f02fcb3c8269 for instance 7b20bc77-0816-42d3-bd06-70e4f233df8e on hv-cinder-85199 Aug 06 20:55:50.775999 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-23a3146e-4f67-4d58-8dac-ddbc5871f238 req-a1391c6b-451b-4edb-bc67-261357384164 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032502 Aug 06 20:55:50.776616 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 616/1228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:56:12.074057 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:56:12.074609 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 20:56:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:57:36.978083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:57:36.978674 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:57:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:57:45.029487 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:57:45.030011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 20:57:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:57:50.368715 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:50.369456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:50.373341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1351432485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194858671", "security_groups": [{"name": "tempest-secgroup-smoke-1242593605"}], "block_device_mapping_v2": [{"uuid": "9365fa33-4f51-4c9a-b14c-f909d8de5580", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a9ab2cf4-8c4c-4e84-b1a3-a1ac3f224ca9"}]}} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:50.560910 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.network.neutron [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] validate_networks() for [('a9ab2cf4-8c4c-4e84-b1a3-a1ac3f224ca9', None, None, None, None, None)] {{(pid=129476) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 20:57:51.000918 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Flavor limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 20:57:51.001347 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Image limits 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 20:57:51.001821 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Flavor pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 20:57:51.002232 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Image pref 0:0:0 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 20:57:51.002645 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.virt.hardware [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129476) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 20:57:51.011349 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.011830 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.012265 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.012987 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:51.013442 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:51.013868 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:51.032414 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 20:57:51.036362 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.quota [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Getting quotas for user 32e65710e03643e981b7e07be5201107 and project dc14593c290f4d2fae5e08c99fcb7492. Resources: {'instances', 'ram', 'cores'} {{(pid=129476) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 20:57:51.091553 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Going to run 1 instances... {{(pid=129476) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 20:57:51.094314 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9365fa33-4f51-4c9a-b14c-f909d8de5580',volume_size=None,volume_type=None)] {{(pid=129476) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 20:57:51.219411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-c1bac809-1f15-44bc-b874-dfcdd5b4df3d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.852275 Aug 06 20:57:51.220208 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 613/1229] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 20:57:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 20:57:51.228929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28cd0d65-7596-4ecc-80d8-344444d8d96a] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 06 20:57:51.229546 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:51.230455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=68 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:51.235043 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-549559e9-bf44-4961-aa00-7f3ed71d18c4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:51.235767 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-549559e9-bf44-4961-aa00-7f3ed71d18c4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:51.348908 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-549559e9-bf44-4961-aa00-7f3ed71d18c4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:51.356823 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-549559e9-bf44-4961-aa00-7f3ed71d18c4 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1095 microversion: 2.1 time: 0.129576 Aug 06 20:57:51.357374 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 617/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:51 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1095 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:52.379674 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:52.380341 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:52.388026 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:52.388594 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:52.389036 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:52.390377 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:52.390829 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:52.392068 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:52.487118 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:52.494474 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d99f8ef9-2325-4909-b820-585c83c837f8 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1211 microversion: 2.1 time: 0.121126 Aug 06 20:57:52.495031 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 614/1231] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:52 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:57:53.517180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:53.518097 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:53.528358 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] [28cd0d65-7596-4ecc-80d8-344444d8d96a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38256. Aug 06 20:57:53.534477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.534973 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.535523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.536226 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.536685 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.537186 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.747480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-e40c1ed8-8ae6-4d96-a1d5-598297b3a55e req-05b51935-4c87-4eb2-bbe7-080bde526426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e50472b-6772-417f-884a-5c3c3880b3e0", "tag": "5375b20a-17cf-45bd-b76a-a6b89d946190"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:57:53.752932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:53.760320 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-e40c1ed8-8ae6-4d96-a1d5-598297b3a55e req-05b51935-4c87-4eb2-bbe7-080bde526426 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:53.761053 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-e40c1ed8-8ae6-4d96-a1d5-598297b3a55e req-05b51935-4c87-4eb2-bbe7-080bde526426 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:53.761376 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5ed53f15-5c76-4a24-9fba-d877531fa2e9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.249503 Aug 06 20:57:53.761940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-e40c1ed8-8ae6-4d96-a1d5-598297b3a55e req-05b51935-4c87-4eb2-bbe7-080bde526426 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:53.762273 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 618/1232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:53 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:53.774123 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-e40c1ed8-8ae6-4d96-a1d5-598297b3a55e req-05b51935-4c87-4eb2-bbe7-080bde526426 service nova] Creating event network-changed:5375b20a-17cf-45bd-b76a-a6b89d946190 for instance 0e50472b-6772-417f-884a-5c3c3880b3e0 on hv-cinder-85199 Aug 06 20:57:53.780616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-e40c1ed8-8ae6-4d96-a1d5-598297b3a55e req-05b51935-4c87-4eb2-bbe7-080bde526426 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037580 Aug 06 20:57:53.781202 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 615/1233] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:57:54.783075 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:54.783741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:54.790119 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:54.790601 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:54.791036 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:54.791747 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:54.792207 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:54.792628 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:54.921025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:54.928381 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-03f867a9-14d9-4734-bd3c-8455f6255953 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.149491 Aug 06 20:57:54.928935 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 619/1234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:54 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:55.950203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:55.950934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:55.957045 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:55.957526 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:55.957957 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:55.958642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:55.959094 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:55.959545 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:56.093879 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:56.101245 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b50adffa-6e21-46fc-abbf-995625127293 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.155652 Aug 06 20:57:56.101803 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 616/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:55 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:57.122114 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:57.122725 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:57.129648 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.130126 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.130557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.131268 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:57.131716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:57.132138 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:57.259636 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:57.266993 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-a69db582-f022-4349-92ba-12a554b4f176 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.148720 Aug 06 20:57:57.267590 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 620/1236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:57 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:58.287119 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:58.287695 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:58.293990 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.294474 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.294912 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.295635 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:58.296089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:58.296511 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:58.425500 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:58.432820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-845e6221-5fa4-4a46-ae0e-cb949de95499 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.149631 Aug 06 20:57:58.433372 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 617/1237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:58 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:57:59.453600 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:57:59.454246 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:57:59.461523 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:59.462012 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:59.462703 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:59.463436 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:57:59.463894 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:57:59.464319 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:57:59.595079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:57:59.602949 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-374b4423-8544-46b1-bfbb-0a3f71b40402 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.153141 Aug 06 20:57:59.603537 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 621/1238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:57:59 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:00.623780 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:00.624391 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:00.630769 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:00.631260 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:00.631728 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:00.632411 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:00.632862 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:00.633286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:00.759755 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:00.767661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-bfe772d4-f037-4f3d-8f38-e3aee94a3452 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.147824 Aug 06 20:58:00.768212 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 618/1239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:00 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:01.788770 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:01.789380 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:01.791766 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell0:SELECT=2 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:01.797332 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.797817 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.798256 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.798982 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:01.799489 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:01.799917 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:01.929832 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:01.937774 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-b878c924-0eb4-4be2-9b1d-58280e558cb2 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.152799 Aug 06 20:58:01.938321 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 622/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:01 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:02.957989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:02.958629 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:02.960643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=2 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:02.961441 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell0:SELECT=6 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:02.968410 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:02.968898 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:02.969337 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:02.970032 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:02.970489 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:02.970917 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:03.099564 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:03.106864 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-8c74db96-293f-43df-8915-961b2635b98e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.152733 Aug 06 20:58:03.107444 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 619/1241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:02 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:04.128187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:04.128798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:04.135205 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.135719 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.136157 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.136842 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.137294 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.137716 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.265474 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:04.272900 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e9b85a31-4a32-4b09-a7db-5959f426f279 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.148522 Aug 06 20:58:04.273411 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 623/1242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:04 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:04.816531 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [req-17a18391-aa5d-4e66-a315-1abf4d7848e0 req-f6626b0c-9b7d-4bdb-bb63-694a6ed5dfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e50472b-6772-417f-884a-5c3c3880b3e0", "name": "network-vif-plugged", "status": "completed", "tag": "5375b20a-17cf-45bd-b76a-a6b89d946190"}]} {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:04.826527 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-17a18391-aa5d-4e66-a315-1abf4d7848e0 req-f6626b0c-9b7d-4bdb-bb63-694a6ed5dfa4 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:04.827011 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-17a18391-aa5d-4e66-a315-1abf4d7848e0 req-f6626b0c-9b7d-4bdb-bb63-694a6ed5dfa4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:04.827470 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [req-17a18391-aa5d-4e66-a315-1abf4d7848e0 req-f6626b0c-9b7d-4bdb-bb63-694a6ed5dfa4 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:04.838546 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.compute.server_external_events [req-17a18391-aa5d-4e66-a315-1abf4d7848e0 req-f6626b0c-9b7d-4bdb-bb63-694a6ed5dfa4 service nova] Creating event network-vif-plugged:5375b20a-17cf-45bd-b76a-a6b89d946190 for instance 0e50472b-6772-417f-884a-5c3c3880b3e0 on hv-cinder-85199 Aug 06 20:58:04.844056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [req-17a18391-aa5d-4e66-a315-1abf4d7848e0 req-f6626b0c-9b7d-4bdb-bb63-694a6ed5dfa4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092133 Aug 06 20:58:04.844623 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 620/1243] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:58:05.293567 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:05.294176 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:05.300567 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.301044 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.301478 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.302313 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:05.302765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:05.303183 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:05.431276 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:05.438662 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-d5e68646-3c31-44b7-9d64-3cc16fb459ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.149007 Aug 06 20:58:05.439218 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 624/1244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:05 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 20:58:06.461203 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:06.461895 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:06.468740 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.469217 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.469648 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.470326 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:06.470772 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:06.471191 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:06.606551 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:06.614228 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-2eb32bd4-b3ba-4ec2-a700-56c9bd315950 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1267 microversion: 2.1 time: 0.157739 Aug 06 20:58:06.614794 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 621/1245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:06 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:07.635034 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.635665 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.642016 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.642501 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.642930 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.643638 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.644083 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.644498 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.779020 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:07.786428 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-5201e86f-1dbb-44ef-b862-04c0741347ca tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1453 microversion: 2.1 time: 0.155249 Aug 06 20:58:07.786983 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 625/1246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:07 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:07.806374 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:58:07.806985 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:58:07.813989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.814469 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.814899 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.815614 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:07.816066 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:07.816482 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:07.944235 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:58:07.951617 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-4936ab70-938d-4734-8e42-313b76678ee3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1453 microversion: 2.1 time: 0.148974 Aug 06 20:58:07.952171 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 622/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:58:07 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 20:58:09.639069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-234e403f-660c-40cf-8105-12bede1f4a43 req-f76e5073-514f-4f47-8c15-1cc87a8e995e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e50472b-6772-417f-884a-5c3c3880b3e0", "tag": "5375b20a-17cf-45bd-b76a-a6b89d946190"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:58:09.648494 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-234e403f-660c-40cf-8105-12bede1f4a43 req-f76e5073-514f-4f47-8c15-1cc87a8e995e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:58:09.648974 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-234e403f-660c-40cf-8105-12bede1f4a43 req-f76e5073-514f-4f47-8c15-1cc87a8e995e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:58:09.649406 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-234e403f-660c-40cf-8105-12bede1f4a43 req-f76e5073-514f-4f47-8c15-1cc87a8e995e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:58:09.660665 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-234e403f-660c-40cf-8105-12bede1f4a43 req-f76e5073-514f-4f47-8c15-1cc87a8e995e service nova] Creating event network-changed:5375b20a-17cf-45bd-b76a-a6b89d946190 for instance 0e50472b-6772-417f-884a-5c3c3880b3e0 on hv-cinder-85199 Aug 06 20:58:09.665802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-234e403f-660c-40cf-8105-12bede1f4a43 req-f76e5073-514f-4f47-8c15-1cc87a8e995e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091304 Aug 06 20:58:09.666407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 626/1248] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:02.353443 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:59:02.354069 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 20:59:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:59:32.083396 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 20:59:32.083870 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 20:59:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 20:59:59.290037 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:59.291354 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG dbcounter [-] [129476] Writing DB stats nova_cell1:SELECT=48 {{(pid=129476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:59.293223 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR oslo.messaging._drivers.impl_rabbit [-] [28cd0d65-7596-4ecc-80d8-344444d8d96a] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 06 20:59:59.293798 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_api:SELECT=22 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:59.294530 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG dbcounter [-] [129475] Writing DB stats nova_cell1:SELECT=50 {{(pid=129475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:59:59.298205 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:59.299056 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:59.299464 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-26387968-cfd7-49f4-b328-2c069c560114 req-d0c8a20d-09b3-40cf-b97b-f6e47b82099e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e50472b-6772-417f-884a-5c3c3880b3e0", "tag": "5375b20a-17cf-45bd-b76a-a6b89d946190"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 20:59:59.308043 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.308548 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.308991 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.309699 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.310154 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.310654 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.312713 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-26387968-cfd7-49f4-b328-2c069c560114 req-d0c8a20d-09b3-40cf-b97b-f6e47b82099e service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.313455 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-26387968-cfd7-49f4-b328-2c069c560114 req-d0c8a20d-09b3-40cf-b97b-f6e47b82099e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.314104 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-26387968-cfd7-49f4-b328-2c069c560114 req-d0c8a20d-09b3-40cf-b97b-f6e47b82099e service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.326642 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-26387968-cfd7-49f4-b328-2c069c560114 req-d0c8a20d-09b3-40cf-b97b-f6e47b82099e service nova] Creating event network-changed:5375b20a-17cf-45bd-b76a-a6b89d946190 for instance 0e50472b-6772-417f-884a-5c3c3880b3e0 on hv-cinder-85199 Aug 06 20:59:59.331839 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-26387968-cfd7-49f4-b328-2c069c560114 req-d0c8a20d-09b3-40cf-b97b-f6e47b82099e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040944 Aug 06 20:59:59.332454 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 627/1249] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 20:59:59.341483 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 20:59:59.428845 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-72dbba74-e18e-436c-9311-49ae4f1c8379 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 204 len: 0 microversion: 2.1 time: 0.140302 Aug 06 20:59:59.432721 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 623/1250] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 20:59:59 2022] DELETE /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 20:59:59.442619 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 20:59:59.445325 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 20:59:59.452753 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.454173 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.455169 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.456013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 20:59:59.456467 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 20:59:59.456892 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 20:59:59.620150 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 20:59:59.627717 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-4af73f19-6e73-4d4e-8eac-f96d041d6259 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1578 microversion: 2.1 time: 0.192750 Aug 06 20:59:59.628284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 628/1251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 20:59:59 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:00.648927 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:00.649627 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:00.656003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:00.656503 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:00.656934 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:00.657633 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:00.658089 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:00.658515 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:00.832255 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:00.840021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-60b4a219-c383-4034-b558-7e17c49047c3 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1578 microversion: 2.1 time: 0.195312 Aug 06 21:00:00.840586 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 624/1252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:00 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:01.730608 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-cbcc1d4d-c7e1-4888-a700-3557a13a74c5 req-52383a0d-941c-443c-9b51-568ad7d266a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e50472b-6772-417f-884a-5c3c3880b3e0", "name": "network-vif-deleted", "tag": "5375b20a-17cf-45bd-b76a-a6b89d946190"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:01.746855 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] [28cd0d65-7596-4ecc-80d8-344444d8d96a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 38350. Aug 06 21:00:01.751291 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-cbcc1d4d-c7e1-4888-a700-3557a13a74c5 req-52383a0d-941c-443c-9b51-568ad7d266a2 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:01.751768 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-cbcc1d4d-c7e1-4888-a700-3557a13a74c5 req-52383a0d-941c-443c-9b51-568ad7d266a2 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:01.752193 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-cbcc1d4d-c7e1-4888-a700-3557a13a74c5 req-52383a0d-941c-443c-9b51-568ad7d266a2 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:01.766264 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-cbcc1d4d-c7e1-4888-a700-3557a13a74c5 req-52383a0d-941c-443c-9b51-568ad7d266a2 service nova] Creating event network-vif-deleted:5375b20a-17cf-45bd-b76a-a6b89d946190 for instance 0e50472b-6772-417f-884a-5c3c3880b3e0 on hv-cinder-85199 Aug 06 21:00:01.771696 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-cbcc1d4d-c7e1-4888-a700-3557a13a74c5 req-52383a0d-941c-443c-9b51-568ad7d266a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045254 Aug 06 21:00:01.772297 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 629/1253] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:01.860971 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:01.861597 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:01.867928 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:01.868419 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:01.868863 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:01.869557 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:01.870560 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:01.870992 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:01.934591 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:01.942097 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-d4523f8d-2e82-4766-bc78-d96c7c6c199d tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 200 len: 1226 microversion: 2.1 time: 0.084956 Aug 06 21:00:01.942659 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 625/1254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:01 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:02.962929 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:02.963931 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 0e50472b-6772-417f-884a-5c3c3880b3e0] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:02.970883 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:02.971407 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:02.971843 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.972521 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:02.972971 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:02.973389 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:02.986476 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] HTTP exception thrown: Instance 0e50472b-6772-417f-884a-5c3c3880b3e0 could not be found. Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Request method failure captured: Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 HTTP/1.1 Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tSEGfvQnl5C7eCHomz0pgcBGoKn7OIH2wGAaf-uoe8x0BJjn3gZ3PeoeTgeuCLtSIZj4pZVmkFMSp-8MeqoOUK2Fgx9ZHGQokIBmFPzWx-qVlADa6bSJRl9IJJGBmUm6sVLcfSwm2C1aL507ACqu7QpEEQwbPgvv2RHlOPzxBWYkec Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 21:00:02.988132 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 32e65710e03643e981b7e07be5201107 Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 0e50472b-6772-417f-884a-5c3c3880b3e0 could not be found. Aug 06 21:00:02.989977 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '0e50472b-6772-417f-884a-5c3c3880b3e0'} Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e50472b-6772-417f-884a-5c3c3880b3e0 could not be found. Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:02.990954 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e50472b-6772-417f-884a-5c3c3880b3e0 could not be found. Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e50472b-6772-417f-884a-5c3c3880b3e0 could not be found. Aug 06 21:00:02.992479 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:02.994222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Returning 404 to user: Instance 0e50472b-6772-417f-884a-5c3c3880b3e0 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:02.994222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-9045d66d-2476-4ce1-98fe-9c036f6d4355 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0" status: 404 len: 111 microversion: 2.1 time: 0.030805 Aug 06 21:00:02.994222 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 630/1255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:02 2022] GET /compute/v2.1/servers/0e50472b-6772-417f-884a-5c3c3880b3e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:06.018471 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:06.018989 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:06.020516 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-5c23d6ab-ecc6-4735-bb8e-7fa51f8f965e req-3f238436-343f-421b-b13e-666f26d06adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b20bc77-0816-42d3-bd06-70e4f233df8e", "tag": "169aa661-65f0-43e4-ac19-f02fcb3c8269"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:06.025661 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:06.026797 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:06.027258 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:06.027958 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:06.028616 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:06.029257 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:06.031904 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5c23d6ab-ecc6-4735-bb8e-7fa51f8f965e req-3f238436-343f-421b-b13e-666f26d06adb service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:06.032632 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5c23d6ab-ecc6-4735-bb8e-7fa51f8f965e req-3f238436-343f-421b-b13e-666f26d06adb service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:06.033117 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-5c23d6ab-ecc6-4735-bb8e-7fa51f8f965e req-3f238436-343f-421b-b13e-666f26d06adb service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:06.044610 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-5c23d6ab-ecc6-4735-bb8e-7fa51f8f965e req-3f238436-343f-421b-b13e-666f26d06adb service nova] Creating event network-changed:169aa661-65f0-43e4-ac19-f02fcb3c8269 for instance 7b20bc77-0816-42d3-bd06-70e4f233df8e on hv-cinder-85199 Aug 06 21:00:06.050237 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-5c23d6ab-ecc6-4735-bb8e-7fa51f8f965e req-3f238436-343f-421b-b13e-666f26d06adb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033151 Aug 06 21:00:06.050925 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 631/1256] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 21:00:06.055159 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Going to try to terminate instance {{(pid=129476) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 21:00:06.140986 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-6c450113-bcf1-4fc3-8bec-e987a006999a tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 204 len: 0 microversion: 2.1 time: 0.126058 Aug 06 21:00:06.145491 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 626/1257] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 21:00:06 2022] DELETE /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 21:00:06.154349 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:06.155224 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:06.163802 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:06.164289 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:06.164718 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:06.165418 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:06.165869 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:06.167098 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:06.335348 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.policy [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129475) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:06.343907 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-13ba8e0d-b51c-4135-a940-fb11a3b9cae6 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1577 microversion: 2.1 time: 0.196666 Aug 06 21:00:06.344560 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 632/1258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:06 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:07.366098 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:07.366858 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:07.373469 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.374003 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.374490 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.375225 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:07.375735 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:07.376185 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:07.531729 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:07.539706 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-b59fcec2-e0db-4de2-8f1e-d7892f2f525c tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1577 microversion: 2.1 time: 0.178163 Aug 06 21:00:07.540301 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 627/1259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:07 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:08.334477 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [req-23af28e3-6fa5-4dcb-9977-494828057206 req-5ab0bb92-e74b-4dd5-ae78-6c3a5b2f6167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b20bc77-0816-42d3-bd06-70e4f233df8e", "name": "network-vif-deleted", "tag": "169aa661-65f0-43e4-ac19-f02fcb3c8269"}]} {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 21:00:08.345508 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-23af28e3-6fa5-4dcb-9977-494828057206 req-5ab0bb92-e74b-4dd5-ae78-6c3a5b2f6167 service nova] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:08.346013 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-23af28e3-6fa5-4dcb-9977-494828057206 req-5ab0bb92-e74b-4dd5-ae78-6c3a5b2f6167 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:08.346472 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [req-23af28e3-6fa5-4dcb-9977-494828057206 req-5ab0bb92-e74b-4dd5-ae78-6c3a5b2f6167 service nova] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.359562 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.compute.server_external_events [req-23af28e3-6fa5-4dcb-9977-494828057206 req-5ab0bb92-e74b-4dd5-ae78-6c3a5b2f6167 service nova] Creating event network-vif-deleted:169aa661-65f0-43e4-ac19-f02fcb3c8269 for instance 7b20bc77-0816-42d3-bd06-70e4f233df8e on hv-cinder-85199 Aug 06 21:00:08.364981 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [req-23af28e3-6fa5-4dcb-9977-494828057206 req-5ab0bb92-e74b-4dd5-ae78-6c3a5b2f6167 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034770 Aug 06 21:00:08.365583 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 633/1260] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 21:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 21:00:08.561283 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:08.561819 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:08.568393 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:08.568884 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:08.569325 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.570022 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:08.570479 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:08.570904 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:08.636940 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.policy [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e65710e03643e981b7e07be5201107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc14593c290f4d2fae5e08c99fcb7492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129476) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 21:00:08.645021 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-361ec1d3-b30a-442b-aeae-0c7eebd86dd9 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 200 len: 1225 microversion: 2.1 time: 0.088126 Aug 06 21:00:08.645771 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 628/1261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:08 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 21:00:09.668861 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:09.669557 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 7b20bc77-0816-42d3-bd06-70e4f233df8e] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:09.675693 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:09.676180 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:09.676615 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:09.677307 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:09.677759 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:09.678184 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:09.691702 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] HTTP exception thrown: Instance 7b20bc77-0816-42d3-bd06-70e4f233df8e could not be found. Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Request method failure captured: Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e HTTP/1.1 Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tSEGfvQnl5C7eCHomz0pgcBGoKn7OIH2wGAaf-uoe8x0BJjn3gZ3PeoeTgeuCLtSIZj4pZVmkFMSp-8MeqoOUK2Fgx9ZHGQokIBmFPzWx-qVlADa6bSJRl9IJJGBmUm6sVLcfSwm2C1aL507ACqu7QpEEQwbPgvv2RHlOPzxBWYkec Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 21:00:09.693298 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 32e65710e03643e981b7e07be5201107 Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 7b20bc77-0816-42d3-bd06-70e4f233df8e could not be found. Aug 06 21:00:09.695025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '7b20bc77-0816-42d3-bd06-70e4f233df8e'} Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b20bc77-0816-42d3-bd06-70e4f233df8e could not be found. Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:09.696079 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b20bc77-0816-42d3-bd06-70e4f233df8e could not be found. Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b20bc77-0816-42d3-bd06-70e4f233df8e could not be found. Aug 06 21:00:09.697670 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:09.699189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Returning 404 to user: Instance 7b20bc77-0816-42d3-bd06-70e4f233df8e could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:09.699189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-e3b1f975-3e1a-4933-8fd2-2bb5ff9508da tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e" status: 404 len: 111 microversion: 2.1 time: 0.031287 Aug 06 21:00:09.699189 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 634/1262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:09 2022] GET /compute/v2.1/servers/7b20bc77-0816-42d3-bd06-70e4f233df8e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:10.133628 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:10.134156 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.compute.api [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129476) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:10.140646 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:10.141075 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:10.141513 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.142214 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:10.142666 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:10.143090 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG oslo_concurrency.lockutils [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129476) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.158642 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.wsgi [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] HTTP exception thrown: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Request method failure captured: Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: request: DELETE /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 HTTP/1.1 Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept: application/json Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Accept-Encoding: identity Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Connection: close Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Length: 0 Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Content-Type: application/json Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Host: 10.222.0.17 Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Openstack-System-Scope: None Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Auth-Token: gAAAAABi7tSEGfvQnl5C7eCHomz0pgcBGoKn7OIH2wGAaf-uoe8x0BJjn3gZ3PeoeTgeuCLtSIZj4pZVmkFMSp-8MeqoOUK2Fgx9ZHGQokIBmFPzWx-qVlADa6bSJRl9IJJGBmUm6sVLcfSwm2C1aL507ACqu7QpEEQwbPgvv2RHlOPzxBWYkec Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Id: None Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Domain-Name: None Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Identity-Status: Confirmed Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Is-Admin-Project: True Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Id: default Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Domain-Name: Default Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Project-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Role: reader,member Aug 06 21:00:10.160286 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Roles: reader,member Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Id: default Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Domain-Name: Default Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Id: 32e65710e03643e981b7e07be5201107 Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: X-User-Name: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: method: > Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: exception: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.162033 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: action_args: {'id': '4edd387a-5c28-447f-8716-7819f66574c7'} Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:10.163018 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.164710 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.166276 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Returning 404 to user: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. {{(pid=129476) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:10.166276 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-1793549f-1de4-4665-ad42-a138cfe57ccf tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 404 len: 111 microversion: 2.1 time: 0.031959 Aug 06 21:00:10.166276 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 629/1263] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 21:00:10 2022] DELETE /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:10.170866 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '>' {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:10.171502 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.compute.api [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] [instance: 4edd387a-5c28-447f-8716-7819f66574c7] Fetching instance by UUID {{(pid=129475) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 21:00:10.177275 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:10.177754 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:10.178187 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.178867 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Acquiring lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 21:00:10.179342 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 21:00:10.179765 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG oslo_concurrency.lockutils [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Lock "ddbdc6e2-4490-4e80-be96-0962cc011caf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 21:00:10.192552 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.wsgi [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] HTTP exception thrown: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Request method failure captured: Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: request: GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 HTTP/1.1 Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept: application/json Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Accept-Encoding: identity Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Connection: close Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Length: 0 Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Content-Type: application/json Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Host: 10.222.0.17 Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Openstack-System-Scope: None Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: User-Agent: python-urllib3/1.26.11 Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Auth-Token: gAAAAABi7tSEGfvQnl5C7eCHomz0pgcBGoKn7OIH2wGAaf-uoe8x0BJjn3gZ3PeoeTgeuCLtSIZj4pZVmkFMSp-8MeqoOUK2Fgx9ZHGQokIBmFPzWx-qVlADa6bSJRl9IJJGBmUm6sVLcfSwm2C1aL507ACqu7QpEEQwbPgvv2RHlOPzxBWYkec Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Id: None Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Domain-Name: None Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Identity-Status: Confirmed Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Is-Admin-Project: True Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Id: default Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Domain-Name: Default Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Project-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Role: reader,member Aug 06 21:00:10.194025 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Roles: reader,member Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/dc14593c290f4d2fae5e08c99fcb7492"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}] Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Id: dc14593c290f4d2fae5e08c99fcb7492 Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-Tenant-Name: tempest-TestVolumeBootPattern-1894955532 Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Id: default Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Domain-Name: Default Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Id: 32e65710e03643e981b7e07be5201107 Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: X-User-Name: tempest-TestVolumeBootPattern-1894955532-project Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: method: > Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: exception: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.195841 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: action_args: {'id': '4edd387a-5c28-447f-8716-7819f66574c7'} Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: {{(pid=129475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 21:00:10.196673 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. Aug 06 21:00:10.198040 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: ERROR nova.api.openstack.wsgi Aug 06 21:00:10.199281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: DEBUG nova.api.openstack.wsgi [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Returning 404 to user: Instance 4edd387a-5c28-447f-8716-7819f66574c7 could not be found. {{(pid=129475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 21:00:10.199281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO nova.api.openstack.requestlog [None req-65baa51a-b3d0-41ed-96d3-8074ffb0ec34 tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7" status: 404 len: 111 microversion: 2.1 time: 0.028979 Aug 06 21:00:10.199281 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: [pid: 129475|app: 0|req: 635/1264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 21:00:10 2022] GET /compute/v2.1/servers/4edd387a-5c28-447f-8716-7819f66574c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 21:00:11.491643 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: DEBUG nova.api.openstack.wsgi [None req-11d2d120-601f-494e-907d-20d6607fd65e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] Calling method '.version_select at 0x7fba95c8c9d0>' {{(pid=129476) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 21:00:11.517101 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO nova.api.openstack.requestlog [None req-11d2d120-601f-494e-907d-20d6607fd65e tempest-TestVolumeBootPattern-1894955532 tempest-TestVolumeBootPattern-1894955532-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1194858671" status: 202 len: 0 microversion: 2.1 time: 0.029243 Aug 06 21:00:11.517637 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: [pid: 129476|app: 0|req: 630/1265] 10.222.0.17 () {58 vars in 1263 bytes} [Sat Aug 6 21:00:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1194858671 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 21:00:40.155180 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:00:40.155820 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 21:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:00:56.986741 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:00:56.987312 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 21:00:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:02:22.362284 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:02:22.362932 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 21:02:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:02:45.040213 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:02:45.040973 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 21:02:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:02:52.091731 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:02:52.092456 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 21:02:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:04:00.162656 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:04:00.163480 dv-cinder-851996-5-iscsi devstack@n-api.service[129476]: Sat Aug 6 21:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:04:16.994679 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:04:16.995230 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 21:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 21:05:42.370435 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 21:05:42.371198 dv-cinder-851996-5-iscsi devstack@n-api.service[129475]: Sat Aug 6 21:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!